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Introduction 


Introduction 

This is the eight book of examples from the Theory of Probability. In general, this topic is not my 
favourite, but thanks to my former colleague, Ole Jprsboe, I somehow managed to get an idea of what 
it is all about. We shall, however, in this volume deal with some topics which are closer to my own 
mathematical fields. 

The prerequisites for the topics can e.g. be found in the Ventus: Calculus 2 series and the Ventus: 
Complex Function Theory series, and all the previous Ventus: Probability cl-c6. 

Unfortunately errors cannot be avoided in a first edition of a work of this type. However, the author 
has tried to put them on a minimum, hoping that the reader will meet with sympathy the errors 
which do occur in the text. 


Leif Mejlbro 
27th October 2009 
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1 Generating functions; background 

1.1 Definition of the generating function of a discrete random variable 

The generating functions are used as analytic aids of random variables which only have values in No, 
e.g. binomial distributed or Poisson distributed random variables. 

In general, a generating function of a sequence of real numbers is a function of the type 

+oo 

A(s) := 'P J CL k s k , for \s\ < g, 
k =0 

provided that the series has a non-empty interval of convergence ] — g, g[, Q > 0. 

Since a generating function is defined as a convergent power series , the reader is referred to the Ventus: 
Calculus 3 series, and also possibly the Ventus: Complex Function Theory series concerning the theory 
behind. We shall here only mention the most necessary properties, because we assume everywhere 
that A{s) is defined for \s\g. 

A generating function A(s) is always of class C°°(] — g, p[). One may always differentiate A(s) term 
by term in the interval of convergence, 

+oo 

A (s) = ^ k{k — 1) • • • (k — n + l)akS k ~ n , for s e] — g, g[. 

k—n 

We have in particular 

A^ n ^(0) = n\ • a n , i.e. a n = -:— for every n G No- 

n\ 
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Furthermore, we shall need the well-known 

Theorem 1.1 Abel’s theorem. If the convergence radius g > 0 is finite, and the series ak @ k 

is convergent, then 

+oo 

y ak Q k = lim A(s). 

^ J S—fQ — 

k =0 


In the applications all elements of the sequence are typically bounded. We mention: 

1) If |a/c| < M for every k E No, then 

+oo 

A(s) = £ ak s k convergent for s E ] — g, g[, where g > 1. 
k =o 

This means that A(s) is defined and a C°° function in at least the interval ] — 1,1[, possibly in a 
larger one. 

2) If a/c > 0 for every fc E No, and Ylt =o a /c = 1, then A(s) is a C°° function in ] — 1,1[, and it follows 
from Abel’s theorem that A(s) can be extended continuously to the closed interval [—1,1]. 

This observation will be important in the applications her, because the sequence (a*,) below is 
chosen as a sequence (pk) of probabilities, and the assumptions are fulfilled for such an extension. 

If X is a discrete random variable of values in No and of the probabilities 
Pk = P{X - k}, for k E No, 

then we define the generating function of X as the function P : [0,1] —> M, which is given by 

+oo 

P(s) = E{s x } := J2P^s k . 

k =0 


The reason for introducing the generating function of a discrete random variable X is that it is 
often easier to find P(s) than the probabilities themselves. Then we obtain the probabilities as the 
coefficients of the series expansion of P(s) from 0. 

1.2 Some generating functions of random variables 

We shall everywhere in the following assume that p E ]0,1[ and q := 1 — p, and fi > 0. 

1) If X is Bernoulli distributed , B{1, p), then 

Po = 1 — V — q an d Pi = P, and P(s) = 1 + p(s — 1). 

2) If X is binomially distributed , B(n,p ), then 

and P(s) = {1 + p(s — l)} n . 
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3) If X is geometrically distributed , Pas(l,p), then 

Pk=pq k ~ \ and P(s) = PS . 

1 — gs 

4) If X is negative binomially distributed , NB(ft,p), then 

p k = (~l) k ( “ K ) pV, and P(s) = • 

5) If X is Pascal distributed , Pas(r,p), then 

Pk= ( r — 1 ) pr « fc_r ’ and P(s) = {l^} ' 


6) If X is Poisson distributed , P(/i), then 

/jjk 

= and P(s) = exp(/i(s - 1)). 

1.3 Computation of moments 

Let X be a random variable of values in No and with a generating function P(s), which is continuous 
in [0,1] (and C°° in the interior of this interval). 

The random variable X has a mean, if and only the derivative P'(l) := lim s ^i_ P'(s) exists and is 
finite. When this is the case, then 

E{X} = P’{ 1). 

The random variable X has a variance , if and only if P"(l) := lim s ^i_ P"(s) exists and is finite. 
When this is the case, then 

V{X} = P"( 1) + P\ 1) - (P'(l)} 2 . 

In general, the n-th moment E {X 71 } exists, if and only if p( n \l) := lim s ^i_ p( n \s) exists and is 
finite. 

1.4 Distribution of sums of mutually independent random variables 

If Xi, X 2 , ..., X n are mutually independent discrete random variables with corresponding generating 
functions Pi(s), P 2 {s), • • •, Pn{s), then the generating function of the sum 

n 

Y n :=Y, X i 

2=1 

is given by 

n 

PyJs) = JJPi(s), for s G [0,1]. 

2=1 
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1.5 Computation of probabilities 

Let X be a discrete random variable with its generating function given by the series expansion 

+oo 

p ( s ) = Y pkS>k • 

k=l 

Then the probabilities are given by 
P{X = k}=p k = 

A slightly more sophisticated case is given by a sequence of mutually independent identically dis¬ 
tributed discrete random variables X n with a given generating function F(s). Let N be another 
discrete random variable of values in No, which is independent of all the X n . We denote the generat¬ 
ing function for N by G(s). 

The generating function H ( s ) of the sum 

Y n #=X 1 +X 2 +'**+X n , 

where the number of summands N is also a random variable, is then given by the composition 
P Yn (s) ■= H(s) = G(F(s)). 



Notice that if follows from H'(s) = G'(F(s)) • F'(s ), that 
E{Y n } = E{N}-E{X 1 }. 

1.6 Convergence in distribution 

Theorem 1.2 The continuity theorem. Let X n be a sequence of discrete random variables of 
values in No, where 


Pn,k := P {X n = k} ,for n G N and k e No, 


and 


+oo 

Pn(s) for s e [0,1] og n e N. 

k=0 


Then 


lim p n k = Pk for every k e N 0 , 

n^+oo 


if and only if 

lim P n (s) = P(s) ( = V Pk ■ 

—Too \ z ' 


+oo 


n^+oo 

If furthermore, 
lim P(s) = 1, 


for all s e [0,1[. 


k=0 


s —> 1 — 


then P(s) is the generating function of some random variable X, and the sequence ( X n ) converges in 
distribution towards X. 
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2 The Laplace transformation; background 

2.1 Definition of the Laplace transformation 

The Laplace transformation is applied when the random variable X only has values in [0, +oo[, thus 
it is non-negative. 

The Laplace transform of a non-negative random variable X is defined as the function L : [0, +oo[ —> M, 
which is given by 

L( A) :=E{e~ xx } . 

The most important special results are: 

1) If the non-negative random variable X is discrete with P {aq} = for all Xi > 0, then 
L(\) := ^2 Pi e~ Xxi , for A > 0. 


2) If the non-negative random variable X is continuous with the frequency /(#), (which is 0 for 
x < 0), then 

r +°o 

L( A) := / e~ Xx f{x) dx for A > 0. 

Jo 

We also write in this case L{f}( A). 



360 ° 
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In general, the following hold for the Laplace transform of a non-negative random variable: 

1) We have for every A > 0, 

0 < L( A) < 1, with L(0) = 1. 

2) If A > 0, then L(A) is of class C°° and the n-th derivative is given by 

{ ^2 i xf e~ Xxi pi, when X is discrete, 

/ 0 +o ° x" e~ Xx f(x) dx, when X is continuous. 

Assume that the non-negative random variable X has the Laplace transform Lx( A), and let a, 6 > 0 
be non-negative constants. Then the random variable 

Y := aX + b 

is again non-negative, and its Laplace transform Ly( A) is, expressed by Lx( A), given by 
L y {\) =£;{e“ A(aX+6) } = e~ Xb L x (aX). 


Theorem 2.1 Inversion formula. If X is a non-negative random variable with the distribution 
function F(x) and the Laplace transform L(X), then we have at every point of continuity of F{x), 

[Xx] /AX/c 

F(x)= ]im y^#) (A)) 

A^+oo J fc\ 
k =0 

where [Xx] denotes the integer part of the real number Xx. This result implies that a distribution is 
uniquely determined by its Laplace transform. 

Concerning other inversion formulae the reader is e.g. referred to the Ventus: Complex Function Theory 
series. 


2.2 Some Laplace transforms of random variables 

1) If X is x 2 (n) distributed of the frequency 


f( x ) 



x n/2_1 



x > 0, 


then its Laplace transform is given by 
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2) If X is exponentially distributed , Til, - ), a > 1, of the frequency 

V a ) 

f(x) = ae~ ax for x > 0, 
then its Laplace transform is given by 

= lf~a 

3) If X is Erlang distributed , r(n, a) of frequency 
^ - —— x ,b ~* exp ( - 

ay 


x n 1 exp ^ , for n G N, o > 0 and x > 0, 


(n — 1)! a 

then its Laplace transform is given by 


LxW = 


I—■■—} 

\ oA + 1 / 


4) If X is Gamma distributed , r(/i, a), with the frequency 
1 exp ( - 

a/ 


_1 exp ^ for /q o > 0 and x > 0, 


r(/i) oE 

then its Laplace transform is given by 


L x ( A) = 


I'V. 

\ aX + 1 / 


2.3 Computation of moments 

Theorem 2.2 If X is a non-negative random variable with the Laplace transform L(\), then the n-th 
moment E {X 71 } exists, if and only if L(X) is n times continuously differentiable at 0. In this case we 
have 

E{X n } = (-l) ra L (n) (0). 

In particular, if L(X) is twice continuously differentiable at 0, then 
E{X} = —1/(0), and E {X 2 } = L"( 0). 


2.4 Distribution of sums of mutually independent random variables 

Theorem 2.3 Let X\, ..., X n be non-negative, mutually independent random variable with the cor¬ 
responding Laplace transforms L i(A) ; ... L n ( A). Let 


Y n = Y J X l 

2=1 


and 



1 

n 




Then 


n 

L Yn (\) = l[L i (\), and L Z JX) = L Yn 
2=1 
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If in particular X\ and X 2 are independent non-negative random variables of the frequencies f(x) and 
g{x), resp., then it is well-known that the frequency of X\ + X 2 is given by a convolution integral, 

/ +00 

f(t)g(x - t) dt. 

-OO 

In this case we get the well-known result, 

L{f*g}=L{f}-L{g}. 

Theorem 2.4 Let X n be a sequence of non-negative, mutually independent and identically distributed 
random variables with the common Laplace transform L{ A). Furthermore, let N be a random variable 
of values in No and with the generating function P(s), where N is independent of all the X n . 

Then Y/v := X\ + • • • + Xn has the Laplace transform 

Ly N (\) = P(L(\)). 

2.5 Convergence in distribution 

Theorem 2.5 Let (X n ) be a sequence of non-negative random variables of the Laplace transforms 

Ln( A). 

1) If the sequence (X n ) converges in distribution towards a non-negative random variable X with the 
Laplace transform L(X), then 

lim L n ( A) = L(A) for every A > 0. 

n^+00 

2) If 


L{ A) := lim L n ( A) 

n^+oo 

exists for every A > 0, and if L(X) is continuous at 0, then L( A) is the Laplace transform of some 
random variable X, and the sequence (X n ) converges in distribution towards X. 
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3 Characteristic functions; background 

3.1 Definition of characteristic functions 

The characteristic function of any random variable X is the function k : M —> C, which is defined by 
k(u) :=E{e iuX }. 

We have in particular: 

1) If X has a discrete distribution , P {X = Xj} = pj, then 


2) If X has its values in No, then X has also a generating function P(s ), and we have the following 
connection between the characteristic function and the generating function, 

+oo 

k(cu) = Y / Pk (e*“) k = P (e*“) . 

k =0 
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3. Characteristic functions; background 


3) Finally, if X has a continuous distribution with the frequency f(x), then 



e™ x 


f(x) dx, 


which is known from Calculus as one of the possible definition of the Fourier transform of /(x), 
cf. e.g. Ventus: the Complex Function Theory series. 

Since the characteristic function may be considered as the Fourier transform of X in some sense, all 
the usual properties of the Fourier transform are also valid for the characteristic function: 

1) For every cu G M, 

|fc(o;)| <1, in particular, k( 0) = 1. 


2) By complex conjugation, 


k{uS) = k(—uj) for ever cu G M. 


3) The characteristic function k(uS) of a random variable X is uniformly continuous on all of M. 

4) If kx{u) is the characteristic function of X, and a, b E M are constants, then the characteristic 
function of Y := aXS + b is given by 

k Y {co) = E j e M<*x+&)J = e iwb kx(aco). 


Theorem 3.1 Inversion formula 

1) Let X be a random variable of distribution function F(x) and characteristic function k(w). If 
F(x) is continuous at both x\ and x 2 (where x\ < X 2 ), then 

1 r A e ~iux 1 _ -iujx 2 

F (X 2 ) — F (xi) = — lim / -:- k(u)du. 

2 tt a .—>+00 J _ x 

In other words em a distribution is uniquely determined by its characteristic function. 

2) We now assume that the characteristic function k(uS) of X is absolutely integrable, i.e. 

/ +00 

|fc(o;)| duj < + 00 . 

-00 


Then X has a continuous distribution, and the frequency f(x) of X is given by 
/(*) = T f +a ° e~ iux k(u)du. 

J — OO 

In practice this inversion formula is the most convenient. 
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3.2 Characteristic functions for some random variables 

1) If X is a Cauchy distributed random variable, C(a,6), a, b > 0, of frequency 
b 


fix) 


for x E ! 


7r {b 2 + (x — a) 2 } 
then it has the characteristic function 
k(uS) = exp (iauj — |cu|). 

2) If X is a x 2 (n) distributed random variable, n E N of frequency 

1 


r Q) 2»/» 


c n/2 1 exp for x > 0, 


then its characteristic function is given by 

n/2 


k(u) 


= (—V 

\ 1 - 2 iu j 


3) If X is double exponentially distributed with frequency 
°L P ~ a \x\ 


fix ) = 2 e 


for xGl, where the parameter a > 0, 


then its characteristic function is given by 
k(uj) = 


a 2 + cu 2 

4) If X is exponentially distributed , T f 1, - ), a > 0, with frequency 

V a J 

f{x) = ae~ ax for x > 0, 
then its characteristic function is given by 
k(u) = 


5) If X is Erlang distributed , T(n, a), where n E N and a > 0, with frequency 

”"* exp (-S 


/fa) 


(n — 1)! a n 
then its characteristic function is 

fcH = {r^—}”• 

[ 1 — xauo J 


for x > 0, 
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3. Characteristic functions; background 


6) If X is Gamma distributed , r(/i, <a), where /i, a > 0, with frequency 
l ‘~ 1 exp ( — ~) 


f(x) 


for x > 0, 


r(/i) 

then its characteristic function is given by 

n 

iauj 1 


k(uS) = 


(—— 
\l -ic 


7) If X is normally distributed (or Gaufiian distributed ), N(/i, cr 2 ), /iGt and cr > 0, with frequency 
, 1 exp , for a; e M, 

\/2^2 K V 2<r 2 / 

then its characteristic function is given by 
k(uj) = exp — 




8) If X is rectangularly distributed , U(a,6), where a < 6, with frequency 

1 


/w = 


b — a 


for a < x < 6, 


then its characteristic function is given by 


k(u) = — 


_ gicoa 


iu)(b — a) 

3.3 Computation of moments 

Let X be a random variable with the characteristic function k{u). If the n-th moment exists, then 
k(uj) is a C u function, and 

fc (n) (0) =i n E{X n }. 

In particular, 

fc'(0) =iE{X} and k"(0) =-E {X 2 } . 

We get in the special cases, 

1) If X is discretely distributed and E {\X\ n } < +oo, then k{uS) is a C n function, and 
k^ (ca) — i n x™ exp (iujXj)pj. 


2) If X is continuously distributed with frequency f{pc) and characteristic function 

P+Oo 


n 

k{u)) = / 

J — ( 


e luJX f(x) dx, 
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and if furthermore, 

/• + oo 


E 


/ i oo 

I x\ n f(x)dx < +oo, 

-OO 


then k{uS) is a C n function, and we get by differentiation of the integrand that 

r+oo 


/ too 

x n & iu>x dX ' 

-oo 


3.4 Distribution of sums of mutually independent random variables 

Let ..., X n be mutually independent random variables, with their corresponding characteristic 
functions ki(uj), ..., k n {uS). We introduce the random variables 

n i -j n 

Y n := V Xi and Z n = - Y n = - V X t . 

n n 

i— 1 i=l 

The characteristic functions of Y n and Z n are given by 

n n 

kY n (<jo) = and kz n (u) = ]^[ k h ^ —^ . 

i— 1 i=l 
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3.5 Convergence in distribution 

Let (X n ) be a sequence of random variables with 

1) Necessary condition. If the sequence (X n ) 
able X of characteristic function k(w), then 

lim k n (uj) = k{uf) for every wGi 

n—s>+oo 

2) Sufficient condition. If 

k(uf) = lim k n {u) 

n—s-+oo 

exists for every w G M, and if also k{u) is continuous at 0, then k(u) is the characteristic function 
of some random variable X, and the sequence (X n ) converges in distribution towards X. 


the corresponding characteristic functions k n (w). 
converges in distribution towards the random vari- 
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4 Generating functions 

Example 4.1 Let X be geometrically distributed, 

(1) P{X = k} =pq k ~\ ke N, 

where p > 0 ; q > 0 and p + q = 1. 

Find the generating function of X. 

Let Xi, X 2 ; ..., X r be mutually independent, all of distribution given by (1), and let 


Y r =X 1 +X 2 + ---+X r . 

Find the generating function ofY r , and prove that Y r has the distribution 

P{Y r = k}=( k r Z{) P r Q k ~ r , k = r,r + 1, .... 


ps 


It follows by insertion that 

oo oo 

P x (s)=E{s x } = =ps5>s) n " 1 = T . 

l — qs 

n =1 n=l 

The generating function Q r (s) for F r = Xl + X 2 + • • • + X r is 

ps 


s G [0,1]. 


i=i 

oo 


qas) = n p x,(s) ^ (fX) =P r s r (i-qs)- s = P r s r Z2( m )(-i r<r* n 

' ^ / m= 0 


—r 


= E 


m —0 


r + 777/ 1 | m m+r 


ra 


V Q s 


= E 


n — 1 
r — 1 


Since also 

Qr(s) = ^P{^ = n}s n , 


p r q n-r s r for [0,1]. 


we conclude that 


p{y P =n} = ( Ei 1 ) p r y i ~ r 


n = r, r + 1, 
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Example 4.2 Given a random variable X of values in No of the probabilities pk = P{X 
k G No; and with the generating function P(s). We put = P{X > k}, k G No, and 


k =0 


Prove that 


Q(s) 


1 - P{s) 

1 — S 


s G [0,1[. 


for s G [0,1[. 


k}. 


We have 

oo oo k 

q k = P{X>k}= J2 P{X=n}= Y, Pn = l~YP n - 

n=k-\-1 n=k -\-1 n=0 


Thus if s G [0,1[, then 


Q{s) 


Y qksk 

k =0 


oo 


E s * 


oo k 


EE^ s * 


i 

1 — 8 


EE^ 


1—8 


oo 

~Y,Pn 


n =0 


1 — 8 



i ~ P(*) 
1 — 8 


Example 4.3 We throw a coin, where the probability of obtaining head in a throw is p, where p G ]0,1[. 
We let the random variable X denote the number of throws until we get the results head-tail in the 
given succession (thus we have X — n, if the pair head-tail occurs for the first time in the experiments 
of numbers n — 1 and n). 

Find the generating function of X and use it to find the mean and variance of X. For which value of 
p is the mean smallest? 


If n = 2, 3, ... and p / then 

P{X = n} = P {Xf = head, i = 1,..., X n — tail} 

+P {Xi = tail, Xi = head, i = 2,..., n — 1, X n = tail} 

+P {Xj = tail, j = 1, 2; Xi = head, i = 3,..., n — 1, X n = tail} 
+ • • • + P {Xj = tail, j ==? 1,..., n — 2; X n _i = head, X n = tail} 

= P n ~\i - p) + (i - p)p n ~ 2 ( i - P ) + (i - p) V“ 3 (i - p) 

•••+(i-p)™- 2 p(i-p) 

n—1 n—1 ^ s j — 1 


Y P n ~ j (i - p) j = P n ~ l a - p) E {^} 

J = 1 3=1 ^ P ' 


1 - 




1 — p 

P 


n —1 


1 - 


1 -P 


= P(1 -P) 


P‘ 


.n— 1 


(i-p) 


n—1 


2p — 1 


{p" _ 1 - (1 -P)" _1 } > n G N \ {!}. 
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If p = - then we get instead 


P{X = u} = n f (\ 


3=1 


n ~ 3 fl\ J _n-l 
2) V 2 / 2 n ’ 


which can also be obtained by taking the limit in the result above for p ^ . 

We have to split into the two cases 1. p — - and 2 . p / 

1) If p = then the generating function becomes 


OO h r) 

p( S ) = Y , 1 




n=2 


2 n 


n=l 


(‘-I)' 


2-8 


2-8 


-1 = 


(2 - 8) 2 2-8 


+ 1 for 8 G [0, 2[. 


2) If p G ]0,1[ and p/ we get instead 


f^p(l-p) 

p(l-p) J 

{p 71 - 1 - (1 -p)”- 1 } s’ 

f ps (1 -p)s ] 

x _p{l-p) _ 
“ 2p-l 

1 _P(!-P) J 

r oo 

£(p*) n 

l n= 1 

' l 

2p - 1 S 1 
1 — p pi 

11 ps l-(l-p)sj 

! p (1 -p)i 

1 2p - 1 1 

, 1 - ps 


n=l 


2p — 1 1—P8 2p — 1 1 — (1 — p)8 

1 — p 1 1 — p p 1 




= 1 + 


2p — 1 1 — p>8 2p — 1 2p — 1 1 — (1 — p)8 2p — 1 

1 — p 1 p 1 


for 8 G 


0, min 


2p — 1 1— ps 2p — 1 1 —(1—_p)8 ? 

} • 

Ip i-pJJ 


In both cases P ,n) (1) exists for all n. It follows from 

E{X} = P'( 1) and V{X} = P"( 1) + P'(l) - {^'(l)} 2 , 
that 

1) If p = then 

P'(s) = 


(2 - 8)3 (2 - s) 2 
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and 


P"(s) 


24 


8 


(2-s) 4 (2 — s) 3 ’ 

hence 

E{X}=P'( 1) =4, 
and 

V{X} = P"(l) + P'(l) - (P'(l)} 2 = 16 + 4 - 16 = 4. 


2) If p e]0,1[, p ± then 


P'(s) = 
hence 
E{X} 


(1 ~ p)p 

2p — 1 1^(1— ps) 2 {1 — (1 — 


-p)s} 2 } 


(1 -p)p J 

r i ii 

L_ 1 J 

1 

T—1 

1 

2p-l 1 

la - p ) 2 {i - (i- p)} 2 j 

1 2p—1 1 

1 1 ~P P J 


1 2p- 1 


2p — 1 (1 ~P)P P(l-P)' 
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Furthermore, 

2(1 -p)p r_ p _ i-p ] 

y ) 2p-l \(l-ps) 3 {l-(l-p)s} 3 J ’ 

thus 

1 1 

+ p(i-p) p 2 (i-p ) 2 

2 f p 1-p] f P 1-P] 1_1_ 

2p — l\l — p p j\l— p p J p(l — p) p 2 {l—p) 2 
4 p 2 — 4p + 2 + p — p 2 — 1 3 p 2 — 3p + 1 p 3 + (1 — p) 3 p 1 — p 

p 2 {l—p) 2 p 2 (l—p) 2 p 2 (l—p) 2 (1 — p) 2 + p 2 

Now, p(l — p) has its maximum for p — — (corresponding to E{X} =4), so p = - gives the 
minimum of the mean, which one also intuitively would expect. 

An alternative solution which uses quite another idea, is the following: Put 
p n = P{HT occurs in the experiments of numbers n — 1 and n}, 
f n = P{HT occurs for the first time in the experiments of numbers n — 1 and n}. 

Then 


VTO = 


2p — 1 I \ 1 — p 


1-p 


(2) Pn — f2Pn—2 H - f3Pn—3 H - ' ‘ ‘ 4“ fn—2P2 T fn • 

We introduce the generating functions 

oo oo 2 

P{s) = 'Y^ p n s n =pq'Y^ s ' n pq- se[0,1], 

n—2 n=2 

oo 

F(s) = J2f n s n . 

n—2 

When (2) is multiplied by 8 n , and we sum with respect to n, we get alternatively 

oo oo (n—2 \ oo oo ( oo 

P(s ) = 'Yi,PnS n = ^2 \ 'YifkPn-k \ S n + ^2fnS n = ^ /fe < ^ Pn-kS 

n—2 n=2 l k=2 ) n—2 k=2 l n=k+2 

oo 

= J2^ k -P(s) + F (s) = F(s){P(s) + 1}, 

k=2 


and we derive that 

P(s) 


F(s) = 


= 1 - 


1 


P(s) + 1 P(s) + 1 

1 — s 


= 1 


= 1 


1 


pq 


= 1 - 


(l-ps)(l-gs) l + pq 


1 — 8 
8—1 


+ 1 


8--) (S~- 

p) V 9 


1 H-< 

pq 


( - - 1 
P 


■ J - 1 


11 I'll 1 

P 9 p q p q ) 


> . 


pg8 2 + 1 — 8 


8 fe +P(8) 
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By differentiation, 



\ if / 

m_ I _ i _ i } 

p-q\(l-ps) 2 (1 -qs) 2 )’ 


hence 

E{X} = F'( 1) = — {4 * 4 } = — ' ~7T~ \ • 

p — 9 U P ) P~Q PQ PQ p(l — P) 

Now, p(l — p) is largest for p = where F?{X} is smallest, corresponding to E{X} = 4. 

Furthermore, 


F"(s) 


Pg f 

P~ g I (1 -ps) 3 


2g ) 
(1 - <?s) 3 / ’ 


SO 


F”( 1 ) 


and 


Pg f 2p _ 2g 

P ~ Q l g 3 P 3 


^'(P + g 2 ) 


2 p 4 — g 4 p 2 — q 2 

p 2 q 2 p — q p 2 — q 2 

2{(p + g) 2 ~2p?} _ 2(1 - 2 pq) 
p 2 q 2 p 2 q 2 


V{X} = F"( 1) + F'(l) - {F'(l)} 2 


2 ~4pg pq_ _i_ 

p 2 q 2 p 2 q 2 p 2 q 2 


1 ~ 3 pq 

p 2 q 2 


which can be reduced to the other possible descriptions 


P_ ,Q_ = P , 1 

p2 (1 — p) 2 p 2 
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Example 4.4 1) The distribution of a random variable X is given by 

l ) pV, k e N 0 , 

where a G p G ]0,1[ and q = 1 — p. (Thus X G NB(a,p).) Prove that the generating function 
of the random variable X is given by 

P(s) =p a (i - qs)~ a , se[o, l], 

and use it to find the mean of X. 

2) Let X\ and X 2 be independent random variables 

Xi e NB (ai,p), X 2 eNB(a 2 ,p), ai, a 2 G M+, pG]0,1[. 

Find the distribution function of the random variable X\ + X 2 . 

3) Let (Y n ) c ^ = 3 be a sequence of random variables, where Y n G NB ^n, 1 -^ . Prove that the 

sequence (Y n ) converges in distribution towards a random variable Y, and find the distribution 
function ofY. 

4) Compute P{Y > 4} (3 decimals). 


P{X = k}= ( -l) k ( 


1) The generating function for X for s G [0,1] is given by 

P(s) = f>l) fe ( ~ a k )p a q k s k =p a (r( ~l ) ( -qs) k 


k =0 

It follows from 


k=0 


(1 — qs) a 


P'(s) 


aqp u 


(1 - qs) a+1 ’ 


that 


E{X} = P'( 1) = 


a qp 


— 


(1 ~q) 


ap q q 

= a • 


F 


a+i 


p 


2) Since X\ and X 2 are independent, the generated function for X\ + X 2 is given by 

CKl +CK2 


X1+X2 


0 ) = 


v 


1 — qs 


p 


1 — qs 


{tG} 


and we conclude that X\ + X 2 G NB (a\ +a 2 ,p), thus the distribution is given by 
P {Xi +X 2 = k} = (-l) fe ( ~ ai k a2 ) p^ +a2 q k , k e No, 
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3) The generating function P n (s) for Y n is according to 1. given by 

-2 

— = e _2 ( 1_s ) = P(s) for n —> oo. 

V-n‘) 

Now, lim s ^i_ P(s) = e° = 1, so it follows from the continuity theorem that (Y n ) converges in 
distribution towards a random variable Y of generating function 

OO oo 

P(s) = e~ 2(1 ~ s) = e~ 2 e 2s = e~ 2 ^ — s n = ^ P{Y = n} s n . 

n= 0 n=0 

When we identify the coefficients of s n , we see that the distribution is given by 

on 

P{ Y = n}=— e~ 2 , neNo, 
n! 

which we recognize as a Poisson distribution, Y G P( 2). 

4) Finally, 



P{Y > 4} 


1 - P{Y = 0} - P{Y = 1} - P{Y = 2} - P{Y = 3} - P{Y - 4} 


i- e_! {i + 2 + 2 + 5 + !} 



0.05265. 
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Example 4.5 Consider a random variable X with its distribution given by 

P{X =k) = k GN, 

where a is a positive constant. 

1. Find the generating function for X and find the mean of X. 

Let X\ and X 2 be independent random variables, both having the same distribution as X. 

2. Find the generating function for X\ + X 2 , and then find the distribution of X 1 + X 2 . 
The distribution of X is a truncated Poisson distribution. 


1) The generating function P(s) is 

k _ 1 ^ (as) k _ e as - 1 


p<») = £p{x = *>»* = ^5; 

k=l ’ ' 

It follows from 


e u — 1 ^' k\ e a — 1 

k=l 


P'{s) = 


e a -V 


that 


a 


= -Hs) = ^ 


2) Since X\ and X 2 are independent, both of the same distribution as X , the generating function is 
given by 


P(s) = P Xl+X2 (s) = p.is) ■ P 2 (s) = 


1 


(e as — 1), s G [0,1]. 


(e a - l) 2 

Then we perform a power expansion of those terms which contain s, 

1 1 00 1 

pis) = -=■ (e 2as -2e as + l) =-* V — \(2a) k - 2a k \ s k 

(e°-l) 2V ' (e*-iy J 

1 00 /c 00 

= Tjrny iEh (2*-2) +*■ = *>»*• 

V c -*-/ k=2 k =2 

By identification of the coefficients it follows that Xi + X 2 has the distribution 
P{X 1+ X 2 = fc}=^-T_^ (2 fe - 2 ) , ***2,3,4,.... 

Remark 4.1 This result can - though it is very difficult - also be found in the traditional way by 
computation and reduction of 

k-l 

P{X 1 +X 2 =k} = ^2P{X 1 =i}-P{X 2 =k-i). 0 

i= 1 
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Example 4.6 A random variable X has the values 0, 2, 4, • • • of the probabilities 
P{X = 2k} =pq k , ke No, 
where p > 0 ; q > 0 and p + q = 1. 

1. Find the generating function for X. 

2. Find, e.g. by applying the result of l. ; the mean E{X}. 

We define for every n G N a random variable Y n by 

Y n = X 1 +X 2 + --' + X n , 

where the random variables X{ are mutually independent and all of the same distribution as X. 

3. Find the generating function for Y n . 

Given a sequence of random variables (Z n )^ =1 , where for every n G N the random variable Z n has 
the same distribution as Y n corresponding to 

-x 1 1 

4. Prove, e.g. by applying the result of 3. that the sequence ( Z n ) converges in distribution towards a 
a random variable Z, and find the distribution of Z. 

5. Is it true that E {Z n } —> E{Z} for n —> oo ? 

1) The generating function is 


oo 


oo 



for s G [0,1]. 


2) It follows from 



that 



Alternatively we get by the traditional computation that 



3) The generating function for Y n = i is 



for s G [0,1]. 
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4) If we put p = 1-. q — —, then Z n has according to 3. the generating function 

2 n 2 n 


Pz n (s) = 


1 - — 
2 n 


2 \ n • 

1 - — 

2 n J 


( CL\ n 

1 H —j —> e a for n —> oo, we get 

= exp Q (s 2 - 1) 


PzM 


for n —> oo, 


where the limit function is continuous. This means that (Z n ) converges in distribution towards a 
random variable Z, the generating function of which is given by 


P z (s) = exp Q (s 2 - 1)^ . 


We get by expanding this function into a power series that 

° J~ V~eto k[ V 2 , 


It follows that Z has the distribution 


P{Z = 2k} = 


1 fl 


k\ \2) ,fe 


for k G No, 


Z 1 

thus — is Poisson distributed with parameter 


5) From 


E{Z n j= n■ 


2 ’ 2ire = . 

1 - — 1 - — 
2 n 2 n 


-j -> 1 = E{Z] for n —> oo, 


follows that the answer is “yes”. 
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Example 4.7 A random variable U, which is not causally distributed, has its distribution given by 


P{U = k} = p k , k e N 0 , 

and its generating function is 

oo 

P( s )=P J PkS k , s £ [ 0 , 1 ]. 

k =0 


The random variable U\ has its distribution given by 


Pk 


P{lh= 0} = 0, P{U l =k} = ^ 


Po 


ke N. 


1. Prove that U-\ has its generating function P\ (s) given by 
P(s) - Po 


Pl(s)= 


1 - Po 


« e [o,i]. 


We assume that the number of persons per household residential neighbourhood is a random variable 
X with its distribution given by 

p <- x = V = wTry 

(a truncated Poisson distribution). 

2. Compute, e.g. by using the result of 1., the generating function for X. Compute also the mean of 
X. 

Let the random variable Y be given by Y = 



3. Compute, e.g. by using the result of 2 ., the mean and variance ofY. 

The heat consumption Z per quarter per house (measured in m 3 district heating water) is assumed to 
depend of the number of persons in the house in the following way: 


Z = 200 < 1 - ( - 




= 200(1 -Y). 


4. 


Compute the mean and the dispersion of Z. The answers should be given with 2 decimals. 


1) A direct computation gives 


p 'M = £i 


Pk 


k =1 


■Po 


1 

1 - Po 




P{s) - Po 
1 - Po 
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2) Also here be direct computation, 



k=l 


Alternatively we can apply 1., though this is far more difficult, because one first have to realize 
that we shall choose 

1 3 k 

Pk = e 3 ' fc[’ keN o, 
with 

P(s) = e 3 *- s_1 / 

Then we shall check that these candidates of the probabilities are added up to 1, and then prove 
that 

P{tfi = fc} = _P*_, fee N, 

1 - Po 

and finally insert 


Pl(s) = Px(8) 


g3(s 1) _ g 3 

1 — e~ 3 




ACCREDITED 


The mean is 

E{X} = P( 1) = 


S = 1 


= 3 


3 3 — 1 


3.15719. 
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3) We get by the definition, 


e 3s - 1 


E {s x } = P x {s) = - 


'\\ 1 

where we obtain the mean of Y = ( - j by putting s = -, thus 


0 




E{Y) = E| 

Analogously, 

E{Y 2 } =E 
hence 


exp u r 1 

n y } = — < 


x 'i exp ( - | - 1 


e 3 - 1 


0,18243. 


= E 


X' 


ex P ( 2 ) + 1 




ex p (2) - 1 

e 3 ~ 1 


> ~ 0.02525. 


4) The mean of Z is obtained by a direct computation, 
E{Z} = 200 E{Y} = 163.514. 

The corresponding dispersion is 

s = VvW} = 200\/F{F} = 31.7786. 
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Example 4.8 Let X\, X 2 , ... be mutually independent random variables, all of distribution given by 


P{Xi = k} =pq k ~\ ke N, 


where p > 0, q > 0 and p + q = 1. 

Furthermore, let N be a random variable, which is independent of the Xi and which has its distribution 
given by 



where a is a positive constant. 

1. Find the generating function P(s) for the random variable X\. 

2. Find the generating function for the random variable Y^i =1 n G N. 

3. Find the generating function for the random variable N. 

We introduce another random variable Y by 

(3) Y = X + + 

where N denotes the random variable introduced above, and where the number of random variables on 
the right hand side of (3) is itself a random variable (for N = 0 we interpret (3) as Y = 0). 

4. Prove that the random variable Y has its generating function Py(s) given by 



0 < s < 1. 


Hint: One may use that 


P{Y = 0} = P{N = 0}, 


00 


P{Y = k} = Y^ P{N = n}-P{X 1 +X 2 + --- + X n =k}, ke N. 


n= 1 


5. Compute the mean E{Y}. 


1) The generating function for X\ is 


00 00 


P(s) = X> fc -V = P S ^( 9S ) fe - 1 = r ^, 5 G [0, 1], 

U — 1 z 1 ^ 


k=1 k= 1 


2) The generating function for ^ 



s G [0,1] og n G N. 
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3) The generating function for N is 




-a g n _ e ~l m e as _ p a(s- 1 ) 


n=0 


4) Now, 

P{Y = 0} = P{N = 0} = e _a , 
so the generating function for Tat is 

oo 

P y (s) = P{Y = 0} + ^2P{Y = k}s k 

k =1 

oo / oo \ 

= e “° + Y [Y P ( N = n} ■ p {X! + X 2 + ■ ■ ■ + x n = k} \ s k 

k= 1 \m =1 / 

oo / oo \ 

= e-“ + ^ ^P{X 1 +X 2 + --- + X n = fc}s fe 

n=l \/c=l / 

oo 

= ^P{iV = n}(P„(s))=Q(P( S )) 


n=0 


= Q ( 1 — ~ ) = exp [a h pS __ - 1 


1 — qs 


1 — qs 


ps — 1 + gs\ / a(s — 1) 

= exp I a - = exp - 

\ l-qs 


1 — qs 

5) It follows from 

P^s)=P Y (s)-al [Y i 

that the mean is 


i + q(s- 1) 


qs (1 - qs) 


2 f ’ 


E{Y} = PyiX) = Py(l) • « • = ~p' 
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Example 4.9 Let X\, X 2 , ... be mutually independent random variables, all of distribution given by 

p «=' : )=ii KD*’ keK 

Furthermore, let N be a random variable, which is independent of the Xi and Poisson distributed with 
parameter a = In 9. 

1. Find the mean of X\. 

2. Find the generating function for the random variable X\. 

3. Find the generating function for the random variable Y^i =1 Xi, n G N. 

4. Find the generating function for the random variable N. 

Introduce another random variable Y by 

(4) Y = X 1 +X 2 + --- + X N , 

where N denotes the random variable introduced above, and where the number of random variables on 
the right hand side of (4) also is a random variable (for N = 0 we interpret (4) as Y = 0). 

5. Find the generating function for Y, and then prove that Y is negative binomially distributed. 
Hint: One may use that 

P{Y = 0} = P{N = 0}, 

00 

P{Y = k} = P{N = n}-P{X 1 +X 2 + ---+X n =k}, ke N. 

n— 1 

6. Find the mean ofY. 


1) The: 


k=l 


2 

_i_3 

In 3 


1 2 1 


l l n 3 3 1 In 3 

~~ 3 3 


2) The generating function for X\ is 

Xl ^ _ In 3 E k \ 3 ) S ~ In 3 Y/ h ( 3 ) _ In 3 ^ 


1 


In 3 k \ 3 J In 3 

k=i v 7 


1 — — 

3 


3) Since the Xi are mutually independent, we get 


Pn(8) = {P Xl (s)} H = 


-/2_ 


In 


\ In3 \3 — 2s 
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4) Since N G P(ln9), we obtain the generating function either by using a table or by the computation 


Pn{$) 


E 


n=0 


(In 9)" 
n! 


e" ln V 


1 00 1 


n —0 


I f,s In 9 _ qs-1 

9 


5) First compute 

P{Y = 0} = P{W = 0} = ( [= P»(0)]. 
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This implies that the generating function for Y is 


Py(s) 


1 OO -j oo oo 

5 + £p{y = fc}»‘ = 5 + ££ P{N = n} • P{X 1 + • • • + X n = k} i 


k=1 


k= 1 n— 1 


1 oo oo f n ..oo 

- + J2p{N = n} • ]Tp I'pCi = k = - + £ P{N = n} • (P Xl (s)) 

n =1 k =1 v 7—1 ) n —1 

OO 1 00 1 / 1 / o 

E = n > ^ ( s )) n = p(p ^ ( s )) = Q E ^ ( 11119 • j^3 ln (^ 


n=0 


\ exp ( 2 ln ( - ^ n 
9 F V V 3 — 2s 


1 


9 ' n! 

n=0 


3 

3^ 


= < 


*-!• 


-I* 


> , 


which according to the table corresponds to Y G NB ^2, - ). 
6) We get by using a table, 


i-i 

E{Y} = 2 • -p- = 4. 
3 

Alternatively, 


p y< s >=H 


I* 


4 

3 _ 27 


1_ r 


3 ’ 


hence 


E{Y} = P^( 1) = A. 1 =4 . 
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Example 4.10 The number N of a certain type of accidents in a given time interval is assumed to 
be Poisson distributed of parameter a, and the number of wounded persons in the i-th accident is 
supposed to be a random variable X{ of the distribution 

(5) P{X i = k} = (l-q)q k , ke N 0 , 

where 0 < q < 1. We assume that the X{ are mutually independent and all independent of the random 
variable N. 

1. Find the generating function for N. 

2. Find the generating function for Xi and the generating function for Y^=i Xi, n E N. 

The total number of wounded persons is a random variable Y given by 

(6) Y = X 1 +X 2 + --- + X Ni 

where N denotes the random variable introduced above, and where the number of random variables on 
the right hand side of (6) is itself a random variable. 

3. Find the generating function for Y, and find the mean E{Y}. 

Given a sequence of random variables (Y n )^ =1 , where for each n G N the random variable Y n has the 

same distribution as Y above, corresponding to a = n and q = . 

3 n 

4. Find the generating function for Y n , and prove that the sequence (Y n ) converges in distribution 
towards a random variable Z. 

5. Find the distribution of Z. 


1) If N e P(a), then 


P{N = n}= ( T e~ a , n G N 0 , 
n\ 

and its generating function is 
Pn(s) = exp(a(s - 1)). 


2) The generating function for X t is 

OO OO 

P Xi (s) = - Q)q k s k = (1 - q) £>)* 


k=0 


k=0 


1 -q 

1 — qs 


The generating function for Y^i=i is given by 

p ^ 1 x i (s)=(T-P) . 

3) Since all the random variables are mutually independent, the generating function for Y = X\ + 
X 2 + • • • + Xn is given by 


Py(s) = Pn (■ Pxi(s )) = exp ( a 


1 ~q 


qs 


— 1)1= exp I aq 


s — 1 
1 — qs 
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4) The generating function for Y n is given by 


, . . 1 8 — 1 
p Y n {s) = exp | n • — • --§- 


1 s-1 


3 n * 


3 1-- 

3 n > 


When n-MX) we see that 


Py n (s) —> P(s) = exp 


8 — 1 


Since lim s ^i_ P(s) = 1, we conclude that P(s) is the generating function for some random variable 
Z, thus 


Pz(s) = exp 


8—1 


5) It follows immediately from 4. that Z G P ( ^ j is Poisson distributed with parameter a = 


Example 4.11 Let X\, X 2 , X 3 , ... be mutually independent random variables, all of distribution 
given by 

P{Xi = k}=px (1 - pi) /c_1 , ke N, hvorpx G]0,1[, 

and let N be a random variable, which is independent of all the Xi-erne, and which has its distribution 
given by 

P{N = n] =p 2 (1 -Pi )" -1 , neM, p 2 e]0,1[. 

1. Find the generating function PxAs) for X\ and the generating function Pn(s) for N. 

2. Find the generating function for the random variable 1 Xi, n G N. 

Introduce another random variable Y by 

(7) Y = X 1 FX 2 + --- + X n , 

where N denotes the random variable introduced above, and where the number of random variables on 
the right hand side of (7) is itself a random variable. 

3. Find the generating function for Y, and then prove that Y is geometrically distributed. 

4. Find mean and variance ofY. 


1) We get either by using a table or by a simple computation that 


p x 1 (s) = Y pi (1 ~ p P 1 s fc =pis-XT 1 -pi ) s f s 1 = r 

k=1 k=l 

We get analogously, 

P 2 S 


P 18 


- (1 ~Pi)s' 


8G [0,1]. 


Pn(s ) 


1 - (P“ P2)s 


for 8 G [0,1]. 
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2) The generating function for Y^i=i is 


3) The generating function for Y is 
P Y (s) = P N (P Xl (s)) = 


P 2 ' 


s G [0,1]. 


V is 

1 - (1 ~Pi)s 


pip 2 s 


1 /1 \ Pi s 


(P1P2) ■ 


1 - (1 ~PlP2)s' 


(1 ~Pi)s 
se [0,1]- 


1 - (1 - Pi) S - (l~P 2 )PlS 


This is the generating function for a geometric distribution of parameter P 1 P 2 , so Y is geometrically 
distributed. 

4) From Y being geometrically distributed of parameter pip 2 it follows that 
E{Y} = — and V{Y} - 1 “ PlP2 


P1P2 


(P1P2) 


2 • 



What if 
you could 
build your 
future and 
create the 
future? 


One generation’s transformation is the next’s status quo. 
In the near future, people may soon think it’s strange that 
devices ever had to be “plugged in.’’ To obtain that status, there 

needs to be “The Shift ’. 
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Remark 4.2 The distribution of Y may also be found without using the generating function. In fact, 

k 

P{Y = k} = ^2 P{N =n}-P{X 1 +X 2 + ---+X n = k}. 

n= 1 


Since Xi + X 2 H-+ X n e Pas (n,pi), we get 


P{Y = k} 


\k—n 


^Tp2(l-P2) n 1 ( k n _ \ (1-pi) 

PlP 2 (1 -Pit -1 ^ k 1 


£=0 


Pi 0 -P2) 


P1P2 (1 - pi) 


1 [1 + Pi 0 - ~ P2) 1 

I 1-Pi J 


l-Pi 
k -1 


PlP2 {1 “Pi +Pl -PlP2} fe 1 = (P1P2) • (1 - PlP2) k 1 


and we have given an alternative proof of the claim that Y is geometrically distributed of param¬ 
eter P 1 P 2 • □ 
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Example 4.12 1. Let U be a random variable with values only in No, and let V = 3 U. Prove the 
following connection between the generating functions of U and V, 

Pv{s) = Pu (s 3 ) , o < s < 1. 

Let the random variable X have its distribution given by 

P{X = 3A;} = p( 1 - p) k ~\ ke N, 

where p is a constant, 0 < p < 1. 

2. Prove, e.g. by using the result of 1. that X has the generating function 

o3 


Px(s) = 


ps" 


0 < s < 1, 


1 — (1 — p)s 3 ’ 
and then find the Laplace transform Lx{ A) of X. 

A sequence of random variables (X n )°°, is defined by X n taking the values —, —, —, ... of the 

n ~ n n n 

probabilities 


3 k 


n 


P l X n = — \ = — 1 - — 


3 n 


1 \ 


k -1 


3n J 


ke N. 


3. Find the Laplace transform Lx n { A) of the random variable X n . 

4. Prove that the sequence (X n ) converges in distribution towards some random variable Y, and find 
the distribution function ofY. 


1) By the definition, 

oo 

Pu(s) = J2P{U = k}s k . 

k =0 

From V = 3 U follows that 

oo oo 

P v (s) = Yi p {V = 3 U = 3s} s 3k = Y p i u = k } s3k = p u (s 3 ) • 

k=0 k=0 


2) Let Y e Pas(l,p) be geometrically distributed. Then 
ps ps 

Py{s) = I^ = 1 - (1 -p)s‘ 

From X = 3T and 1. we get 

o3 


Px(s) = 


ps" 


1 — (1 — p)s 3 
The Laplace transform of X is 


L x ( A) = Y P { X = 3fc}e“ 3feA = Yp^ 1 


-1 -3fcA 


/c=l 


= p • e 


—3A 


fc=l 
, fe -1 


3A 


V((l- p)e ~ 3X \ lc ~ 1 = _ v — 

P) e i i — (i — p) e ~ 3X ' 
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3) We derive the Laplace transform of X n from the Laplace transform of X by putting p = — and 
A 3 n 

by replacing A by —, thus 
n 


LxA A) = 


3A 

exp 

3 n \ n 


1 

3 n 


3 n 


3A 


1 — (1 — -— ) exp-exp H-— 1 + — 


3A 


3 n 


4) Now, 


'3A\ , 1 , 3A 1 /1\ ^ 1 1 ^ 1 (1 

ex Pl~) _1 + ~- 1 + ~ + r £ r _1 + ^r-5r( 1 + 9A ) + r £ 


3 n 


n n \n 


3 n 3 n 


n \n 


LxS A) = 


, / 1 \ 1 H- 9A 

1 9A s ( — 

n 


= L Z ( A), 


where Z E T 


zer 




is exponentially distributed, thus (X n ) converges in distribution towards 




In the past four years we have drilled 


81,000 km 

A 

That's more than twice around the world. 

Whn am wn? 

0-=> 

We are the world's leading oilfield services company. Working 
globally—often in remote and challenging locations—we invent, 
design, engineer, manufacture, apply, and maintain technology 

to help customers find and produce oil and gas safely. VI 

Who are we looking for? 

We offer countless opportunities in the following domains: 

■ Engineering, Research, and Operations ^ 

■ Geoscience and Petrotechnical 

■ Commercial and Business 

i — • 

If you are a self-motivated graduate looking for a dynamic career, 

apply to join our team. 

What will you be? 

careers.slb.com 

Schlumberger 


44 

Download free eBooks at bookboon.com 









Analytic Aids 


4. Generating functions 


Example 4.13 A football team shall play 5 tournament matches. The coach judges that in each 

2 2 1 

match there is the probability - for victory, - for defeat, and - for draw, and that the outcome of a 

OO 0 

match does not influence on the probabilities of the following matches. 

A victory gives 2 points, a draw gives 1 point, and a defeat gives 0 point. 

Let the random variable X indicate the number of victories in the 5 matches, and let Y indicate the 
number of obtained points in the 5 matches. Then we can also write 


X = Y X > 

i= 1 


5 

and Y = Yi , 


where 


Xi = 


1, 

0, 


and 


if victory in match number i, 
otherwise , 


Yi = 


2, 

1, 


if victory in match number i, 
if draw in match number i, 


0, if defeat in match number i. 

1) Compute P{X = k}, k = 0, 1, 2, 3, 4, 3, and the mean E{X}. 

2) Find the mean and variance ofY. 

3) Compute P{Y = 10}. 

4) Compute P{Y = 8}. 

5) Find the generating function for Yi, and then find (use a pocket calculator) the generating function 
for 


y = t Y >- 

i =1 


Compute also the probabilities P{Y = k}, k = 0, 1, 2, ..., 10. 

6 ) In the Danish tournament league a victory gives 3 points, a draw gives 1 point, and a defeat gives 
0 point. Let Z denote the number of obtained points in the 5 matches (all other assumptions are 
chosen as the same as above). Then Z can as value have all integers between 0 and 15, with one 
exception (which one?). Find all the probabilities by using generating functions in the same way 
as in 5.. 


i) 


Since X G B 



is binomially distributed, we get 


p k = P{X = k}=(l 



k = 0, 1, 2, 3, 4, 5, 
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We get more explicitly, 



The mean is 

E{X} = 5 • - = 2. 
5 


243 

3125’ 

810 _ 162 
3125 ~ 625’ 

1080 _ 216 
2125 “ 625’ 
720 _ 144 
3125 “ 625’ 

240 _ 48 
3125 “ 625’ 

32 

3125' 


2) The mean of Y{ is 

-E{'n} = 2 | + 1 |+o| = i 


for i = 1, ..., 5, 


and since 


E{K 2 } 



for i = 1, ..., 5, 


the variances are 


V{Y i }=^- l 2 


4 

5 


Now the Yi are mutually independent, so it follows that 


E{Y} = Y J E{Y i } = 5 




5 

and V{Y} = ^V {Yi} = 4. 


3) If Y = 10, then the team must have won all 5 matches, thus 

P{y . 10} = P{X = 5} = (f)' = 3^. 


4) The case Y = 8 occurs if either we have 4 victories and 1 defeat, or 3 victories and 2 draws. Hence 


P { y = 8 }- 5.(|) 4 | 


5 \ /2\ 3 /1\ 2 _ 5-2 5 + 10-2 3 _ 240 _ 48 
3 J 1^5/ V5/ “ 5 s - 3125 1 625' 
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5) From 

2 1 2 
Po = g, Pi = g and p 2 = 

follows that the generating function for each Y{ is given by 

a ( s ) = 5 s2+ 5 S+ 5 = 5 ^ 2s2 + s + 2 ) • 

This implies that the generating function for Y = ^ is given by (either by using a pocket 

calculator or MAPLE) 

p y(s) = «M 5 = (| + |) 

32 10 16 o 48 c 72 7 114 6 561 «= 114 4 72 , 

= -s 10 H-s 9 H-s 8 H-s' H-s 6 H- s° H-s 4 H-s 3 

3125 625 625 625 625 3125 625 625 

48 2 16 32 

H- s H - - s -f--. 

625 625 3125 


It follows that P{Y = k} is the coefficient of s k . 

6) Clearly, P{Z = 14} = 0. In fact, 5 victories gives 15 points, and the second best result is described 
by 4 victories and 1 draw, corresponding tofc = 4- 3 + l- l = 13. 

In this new case the generating function for each Zi is given by 

7 / x 2 o 1 2 1,o \ 

b ( s ) - 5 s + 5 S+ 5 _ 5 ^ 2s + s + 2 )> 
where we have replaced s 2 by s 3 . 

Thus the generating function for Z = XLi is given by 


Pz(s) 


,, ,5 (2 3 1 2 

w={r + r + i 

—»“ + o ■ » 14 + — » 13 + — « 12 + — « n + —»“ + —» 

3125 625 625 625 625 625 

16 2 16 

-s 2 0- s ■ 

625 625 


98 

625 


16 

125 


241 

3125 


66 

625 


125 


9 


i^s< 

625 

32 

3125’ 


which can also be written in the following way, in which it is easier to evaluate the magnitudes of 
the coefficients, 


P z {s) = —t- {32s 15 + 80s 13 + 160s 12 + 80s 11 + 320s 10 

olZo 

+360s 9 + 240s 8 + 490s 7 + 400s 6 + 241s 5 +330s 4 + 200s 3 + 80s 2 + 80s + 32} . 


Since P{Z = k} is the coefficient of s k in Pz(s), we conclude that under the given assumptions 
there is the biggest chance for obtaining 7 points, 


P{Z = 7} 


490 

3125 


98 

625' 
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5 The Laplace transformation 

Example 5.1 Let X be exponentially distributed of the frequency 

{ ae~ ax , x > 0, 

0, x < 0. 

Find Lx{ A), and use it to find E{X} and V{X}. 


We first note that 


r 

L x( A) = 

Jo 


a e 


e~ Xx dx = a f e ~( x+a ) x dx = 

Jo 


A -f- a 


Hence 

E{X} = [-L' x (A)] a=0 = 
and 

E{X 2 })[L"(A)] a=0 = 


(a + a y 


A=0 


a 1 


a* a 


2 a 


(A + a) 3 


A=0 


2a _ 2 



/ i 

Maastricht University 


Join the best at 

Top master's programmes 
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School of Business and 
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• 1 st place: MSc International Business 
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• 2 nd place: MSc Economics 

• 2 nd place: MSc Econometrics and Operations Research 

• 2 nd place: MSc Global Supply Chain Management and 

Change 

Sources: Keuzegids Master ranking 2013; Elsevier 'Beste Studies' ranking 2012; 

Financial Times Global Masters in Management ranking 2012 


Maastricht 

University is 
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university in the 
Netherlands 

(Elsevier) 

Master's Open Day: 22 February 2014 

www.mastersopenday.nl 
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from which 


V{X} = E{X 2 } - ( E{X }) 2 


2 1 1 



in accordance with previous results. 

Example 5.2 Let X\, X 2 , ... be mutually independent random variables, where X & is Gamma dis¬ 
tributed with form parameter k and scale parameter 1, thus Xk E r(fc, 1), k E N. Define 


n 



and Z n = —Y n , n E N. 

n ^ 


n■ 


1) Find the means E {Y n } and E {Z n }. 

2) Find the Laplace transform ofY n and the Laplace transform of Z n . 

3) Prove, e.g. by using the result of 2 ., that the sequence (Z n )^ =1 converges in distribution towards a 
random variable Z, and find the distribution function of Z. 

We get from Xk E r(fc, 1) that 


E {Xk} = k and 



1) The means are 



k =1 


k=1 



2) From 



follows that 



( n +i) 


Alternatively, 



thus the same result. 
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Since Lz n ( A) is obtained from Ly n ( A) by replacing A by we get 


n* 


L z n (A) = L Yn ( -y ) = 


i+4 


n(n +1) 


3) Since the denominator converges for n —> oo, 

n(n+1) 


1 


A 


= 1 


A 


1 + 


A 


(e A • l) 2 = exp 


for n —> oo, 


we get 


Lz n {\) -> exp -J = Lz(X) for n -> oo, 

so (Z n ) converges in distribution towards a causally distributed random variable Z with the dis¬ 
tribution function 


fzW = 


0 for z < 


1 for 2 > -. 

“ 2 



> Apply now 


REDEFINE YOUR FUTURE 

AXA GLOBAL GRADUATE 
PROGRAM 2015 


redefining /standards 
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Example 5.3 A random variable Z has the values 1, 2, ... with the probabilities 
1 a k 

P{Z = k] = ■ y, 

where p > 0, q > 0 and p + q m 1. We say that Z has a logarithmic distribution. 

1. Find the Laplace transform Lz{X) of Z. 


2. Find the mean of the random variable Z. 

We consider a sequence of random variables (X n )^ =2 , where X n has the values 1,2,... of the 
probabilities 


P{X n = k} = - 


1 

1 npn 


4 

k ’ 


where q n = — and p n + q n = 1 - 
n 

3. Prove that the sequence (X n ) converges in distribution towards a random variable X, and find the 
distribution function of X. 


1) The Laplace transform is 

oo 

L z ( A) = ]TP{Z = n}e An 

n= 1 


1 

In p 


E 


q‘ L 

n 


e -\n 


1 y, (q e A ) n _ In (l — qe A ) 
In p ^ n In p 

n= 1 


2) By a straightforward computation, 

i 00 n k i 

E{ Z } = -f-Tk- q - = -X 

In p k In p 1 


In p 

Alternatively, 


k=l 


In p 1 — q 


p In p 


E { Z)=-L' z{ 0) = -- 


ge 


-A 


1 — qe 


-A 


CL 


q 


A=0 


1 


lnp 1 — q p In p 


3) It follows from 1. that 


-OVA) 


In (1 - gfce A ) 
In Pk 



For every fixed A > 0 we get by rHospital’s rule, where we put x = 


1 

V 


lim L Xk (\) 

k—>oo 


lim 

k—>oo 



In fl — x e x ) 
lim — 

x^o ln(l — x) 


o -A 


r 1 — x e _A -a 

lim -.- = e . 

I 


1 — X 
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If A = 0, then Lx k = e 0 for every k, so 


LxW 


for A > 0, 


[ 1 for A = 0, 

and Lx( A) exists for all A > 0, and it is continuous at A = 0. This implies that (X n ) converges 
in distribution towards some random variable X , which has the Laplace transform Lx( A) = e -A , 
from which we conclude that X is causally distributed with a = 1, thus P{X = 1} = 1. 


Example 5.4 A random variable X has the values 1,2,... of the probabilities 
P{X = k} = pq k ~ x , hvor p > 0, q > 0, p + q = 1. 

1. Find the Laplace transform of X. 

1 2 

We consider a sequence of random variables (A n )°°_ 1? wAere X n has the values —, —, ... of the 

n n 

probabilities 



(here a e]0, 1[ is a constant). 

2. Prove that the mean of X n does not depend on n. 

3. Find the Laplace transform of X n . 

4. Prove that the sequence (X n ) converges in distribution towards a random variable Y, and find the 
distribution function ofY. 


1. The Laplace transform is 


LxW = Y ' 


—Xn^^n—1 _ P 


pq 


= p -Y( qe - x ) n = v -'- q ‘ e 

q ^ v ’ q 1 


-A 


pe 


-A 


n —1 n —1 

2. and 3. The Laplace transform of X n is 


— qe x 1 — qe 


-A • 


LxW = 


n= 1 x 7 n k=l K x 7 7 


a f A 

- exp- 

n \ n 


1 - ^ 




a 

n 


exp 

1 


1 — A 


03 


exp 


a 

n 






exp 


1 - 

n 
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hence 


E{X n } = 


a 


-L' Xn (0) = - 


n 



n 



A=o 



1 

_ 5 

a 


which is independent of n. 

4. It follows by l’Hospital’s rule that 


exp 


lim L Xn { A) = 


lim 

n—^ oo 


- 0 -;;) exp (- 


n 


= lim 


axe 


—Xx 


o 1 — (1 — ax)e~ Xx 


Q — Xx 


= a lim 


Xxe 


— Xx 


x^o A(1 — ax)e~ Xx + ae~ Xx 


= a lim 


1 — Xx 


o A(1 — a x^j -\- a X a 


= L y (X ), 


and we get by using a table that F E T 
converges in distribution towards F. 



is exponentially distributed. This proves that (X n ) 
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'Ills to meet the increasing need of businesses.The 
MSc programmes provide a stimulating and multi¬ 
cultural learning environment to give you the best 
platform to launch into your career 


* MSc in Business 


NORWEGIAN 
BUSINESS SCHOOL 


EFMO 

EQU15 


* MSc in Leadership and Organisational Psychology 
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Example 5.5 A random variable X has the values 1,2,... of the probabilities 


P{X = k} = 


,fe-i 


k e N, 


(fc-l)! ’ 

where a is some positive constant. 

1. Find the Laplace transform of X. 

2. Find the mean of X. 

We consider a sequence of random variables (Y n )^ =1 , where for each n E N the random variable Y n 
has its distribution given by 


L-s} 


(2 n) 


k-1 


p ^ = Tu] = w^y. e ~ 2n ’ k€K 

3. Find the Laplace transform ofY n . 

4. Prove, e.g. by using the result of 3 ., that the sequence (Y n )^ =1 converges in distribution towards a 
random variable Y, and find the distribution function ofY. 

5. Is it true that E {F n } —> E{Y} for n —> oc ? 


1) The Laplace transform of X is 


OO h. _1 oo u 

or / _xx/c 




— A\ 


k= 1 v 7 k =0 

= exp (—a — A + a e _A ) = exp (a (e _A — l) — A) 


A > 0. 


2) The mean is 


OO b — ~\ 

a k 


k =1 V J k=0 L/c 

Alternatively, 

L' x ( A) = (—1 — a e -A ) exp (—a — A + a e -A ) , 
sa 

E{X} = -L' x {0) = l + a. 

3) The Laplace transform of X n with a = 2n is 


h OO 

a* ^ 1 


£ T= H £ + £ s “*)= <r > +1 > e “=“ +L 


Lx ( a = 2 n^j = exp ^—2 n — A + 2 n exp ^ = exp ^2n |exp — 1 j> — A^ . 


Since X n = 2nY n , the Laplace transform of Y n is given by 

ir.(A) = L x , (A) = exp ( 2 „ {exp (- A) - 1 } - A ), A > 0. 
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4) It follows from 


£y n (A) 


exp 



L + L e (X] 

2 n 2 n \2n) 



exp 


(-\ + \e 




A') 

2 n ) 

for n —> oo, 




that F n —> Y, where Y has the distribution function 


Fy(v) 


1 for y > 1, 

0 for y < 1. 


5) Since 

we conclude that the answer is “yes”. 


Example 5.6 A random variable X has the values 1, 3, 5, ... of probabilities 
P{X = 2k + l} =p(l-p) k , ke No, 
where p is a constant, 0 < p < 1. 

1. Find the Laplace transform Lx{ A) of the random variable X. 

2. Find the mean of the random variable X. 

13 5 

We consider a sequence of random variables (X n )^_-, . where X n has the values of the 

n n n 

probabilities 

p { x "= 2 A}AAA- ^ 

3. Find the Laplace transform Lx n { A) of the random variable X n . 

4. Find the mean of the random variable X n . 

5. Prove that the sequence (X n ) converges in distribution towards a random variable Y, and find the 
distribution function ofY. 


1) The Laplace transform is 


Lx( A) = y^p(l-p) fe exp(-A(2fc + l)) =pe A ^{(l-p)e 2A }* 


k=0 


k=0 


pe 


-A 


pe^ 


i - (i -p) 


e -2A e 2A — (1 — p) 
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2) The mean is 
E{X} = 


^T(2k + l)p(l - p) k =2p(l-p)^Tk(l-p) k 1 +p'^T(l-p) k 


k=0 


= 2p(l-p) 


k =1 

1 1 

-V' 


k=0 


{1 - (1 ~P)} 2 * 1-(1 ~P) 

M 1 -p) + P = 2 1 -P x = 2 _ j 


Alternatively, 
L' x (X) = L x (X) 
thus 


P 


p 


V 


2pe* 


d 2A 


~ (1 ~ P) {e 2A - (1 - p)} 2 


E{X) = -Li(0) = -1 + ^ = | - 1. 

3) If we put p = —, then we get Lx (A) from LxM by replacing A by —, thus 
2 n n 


Lx n W = L x ( - ) = 


A 

7T ex P 

2 n \n 


exp 


n 




2 " { exp (?) - 1 } + 1 


4) It follows from 


L' Xn (\) = -mL Xrl (\)- 

n n 


"A 

exp ( - 
\n 


2 n ( exp ( — j — 1 ) + 1 


2 

•2 n • —, 


that 

iU*„} = -LU0) = -t+4 = 4-i. 

Alternatively, 




k=0 


n 2n 


2 n J 


k =1 


fc-1 


( 1 _±\f' k ( 1 _±\ I.— V 1 _ JL 

n 2 V 2n / V 2n J n 2n ^ \ 2n 


n 2 V 2n 


n 2 V 2n 


1 - 1 - — 
2n 


2 2n 2 


/c=0 

1 1 


1 1 2n 


_i_ i 1 _ / n i_ i 

1 \ 2 ^ 2 n 2 1 \ 2 n) n n 


2 n 


2 n 
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5) It follows from 



that 



2A 

1 = 1 + 4A + 4A e ( — 


Lx n W 



+ 1 



1 + 4A + 4A 5 



1 

1 + 4A 


for n —> oo. 


Now, 


1 


1 4A 


is continuous for A G [0, oo[. Hence (X n ) converges : 


variable Y, where Ly( A) = ^ ^ corresponds to Y G r(l,4), i.e. 

frequency 


distribution towards a random 
an exponential distribution of 


fy(y ) = < 



0 


for y > 0, 
for y < 0. 
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Example 5.7 The random variables X\, X 2 and X 3 are assumed to be mutually independent and 
each of them following a rectangular distribution over the interval ]0,1[. 

Let X denote the random variable 


X = X 1 + x 2 + x 3 . 

1) Find the mean and variance of the random variable X. 

Hint: Find first the frequency of X 1 + X 2 . 

2) Find the Laplace transform L(A) of the random variable X, and prove that 

L( A) = ^- ~ -X 2 F X 2 e(X). 


1) We conclude from 

E {X,} = E {X 2 } = E {X 3 } = f 
that 

E{X} = E{X 1 }+E {X 2 } + E {X 3 } = |. 

Since 

V{X 1 } = V{X 2 } = V{X 3 } = ±, 
and Xi, X 2 and X 3 are mutually independent, we get 
V{X} = V{X 1 } + V{X 2 } + V{X 3 }=3-± = f 
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2) The frequency g(y) of Y = X\ + X 2 is 0 for y ^ ]0, 2[. If 0 < y < 2, then 

g(y) = [ f(y - s)f(s)ds. 

Jo 

Hence, for 0 < y < 1, 

g(y)=[ f(y-s)f(s)ds= f l-lds = y. 

Jo Jo 

If 1 < y < 2, then we get instead 

g(y)= [ f(y-s)f{s)ds= f l-lds = 2-y. 

Jo Jy—i 

Summing up, the frequency of Y = X\ + X 2 is given by 
y for y]0, 1[, 

g(y) = { z-y for y e [l,2[ 

0 otherwise. 



The frequency h(x) of X = X\ + X 2 + X 3 = Y + X 3 is 0 for x ^ ]0, 3[. 
If 0 < x < 3, then 


fC nX 

g(s)f(x - s)ds = / g(x - s)f(s)ds. 

Jo 

We shall now split the investigation into the cases of the three intervals ]0,1[, [1, 2[ and [2, 3[. 
a) If x e ]0,1[, then 



f x 

h(x) = / g{x — s) • 1 ds = 
Jo 



1 

2 


(*-s ) 2 


s=o 


x 2 

T' 


59 


Download free eBooks at bookboon.com 











Analytic Aids 


5. the Laplace transformation 


b) If x G [1, 2[, then 

h(x) = / g(x — s)/(s) ds = / g(x — s) • 1 (is 

Jo Jo 

[x - 1 r 1 

= / g(x — s) ds + / g(x — s) (is 

Jo Jx-l 

= f {2 — (x — s)} ds-\- f ( x — s)ds 

Jo Jx-l 


- (2 — a; + s) 2 


X —1 

- s=0 
2 


- 2(*-*) 2 


_ S=X—1 


= - {(2 - X + x - l) 2 - (2 - a;) 2 + (x - x + l) 2 - (x - l) 2 } 

= \ I 1 - (x ~ s) 2 + 1 - (a; - l) 2 } 

= ^ {2 — x 2 + 4x — 4 — x 2 + 2x — l} = ^ {—2x 2 + 6.x* — 3} 

3 / 3 ° 

4 V 2 

c) If x G [2,3[, then 

pX pi pX p 2 

/t(x) = / g(x — s)f(s) ds = / g(x — s) • 1 (is = / g(t) dt = / g(t) dt 

Jo Jo Jx-l Jx-l 


f (2 — t) dt 

J x—l 


l 2 




1 (2-a; + l) 2 _ 1 


x—1 


= 2(3-t. 


Summing up, the frequency h(x) of X is given by 


h(x) = < 


1 2 

2 * 

for x G ]0,1[, 

/ 3\ 2 

for x G [1, 2[, 

GO 

(3-») 2 

for x G [2, 3[, 

0 

otherwise. 


3) When A > 0 and i = 1,2, 3, then 


pOO pi 

L Xi ( A)= / e~ xt f(t) dt = / , 
Jo Jo 


= / e ~ xt dt = 

0 


_ A 6 


— At 


1 — e 


-A 
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Since Xi, X2 and X3 are mutually independent, we get 


Lx( A) = 


1 — e 


-A 




- E 


A J A 3 

( l) n—1 


(-ir 


n=0 


n! 


-IsE 


(-l)n+i 


A" 


n=1 


n! 


(-1 r 


^ n=l 


n! 


A J {§(" + !)! 


- 1 1 ~ \ + y + A2ff(A) 


A 


A 


1 + —-A + — + A e(A) nl-7 + 7+ A e(X) 


A A 2 


6 


12 


A A 2 


1 - A + — A +A e(A) pp—7 t + -7"+A e(A) 


6 


1 ■ (1 + x ) A+ Q + \ + h) a2+a2£(a) - 1 -1 A+2 + i2 + 7 a2+a ' £(a) 

1-~ a +~ a2 + A 2 e(A). 
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Example 5.8 A random variable Y has the frequency 

{ a 2 y e ~ ay , y > 0 

0, y < 0, 

where a is a positive constant. 

1. Find the Laplace transform Ly(X) of the random variable Y. 

2. Find the mean of the random variable Y. 

A random variable Y has the values 0, 1, 2, 3, ... of the probabilities 
P{X = k} = (k + l)p 2 q k , 
where p > 0 , q > 0 , p + q = 1 . 

3. Find the Laplace transform Lx (A) of X. 

Find the mean of X. 

1 2 

A sequence of random variables (X n ) is given by X n having the values 0, . of the probabilities 

n n 

where a is a constant, 0 < a < 1. 

5. Find the Laplace transform of X n . 

6. Find the mean of the random variable X n . 

7. Prove that the sequence (X n ) converges in distribution towards a random variable Y (as defined 
above). 

8. Prove that E {X n } —> E{Y} for n —> oo. 


1) If A > 0, then 


r 

Ly{ A) = / 
Jo 


a 2 ye~ ay e~ Xy dy = 


(A + a)‘ 


nOO 

/ (a + A) 
Jo 


2 ye~( a+Xy) dy = “ 


(A + a) 2 



2) The mean is 


E{Y} = -L'y( 0) 



1 

a 


2 

a 


A=o 
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3) If A > 0, then 


Lx( A) = £ e~ Xn (n + 1 )p 2 q n = + 1 )p 2 (qe~ x ) n = 


n =0 


n=0 


(1 - ge A )" 


4) The mean is 


—2 

E{X} = -V x (0) = - lim --^—3 

A^O (1 _ ge _A ) 


= ^=2®. 
(i-g) 3 p 


5) If X n , then 

Wai-E-pK) + U (;)>-;)' 


k=0 


© s 




2 ' 


6) The mean is 

E{X n } = ~L' X J 0) = -lim 0 2 -(-2) 

= © 


(-3 


exp 


A A f 1 


n / v n 


(i-»p(- A ) (i-s)} 


\ 2 . 


2 

. / 


1 

2 

1 g 

1 

t—l 

2 

2 

) 

H 

'l - -) 
v nJ 

} 3 

V n) 

n 

n 

a 

n 

a 

n 


7) We get by a rearrangement, 


£x n (A) = 


& 


yexp(-i) (1-3} {"-»p(“) ("-»)} 


where 


A 


n — exp ( — — J • (n — a) = n 11 — exp ^ | + a • exp ^ — — 

= n(l-|l-^ + ^e }) + a eXP ^ 
x A / A A 

= A + n • — 5 — + a • exp-—» A + a tor n —> oo. 

n \n J \ nJ 


A 


Hence 

lim L Xn {\) = , A2 = L y { A). 

n—>oc (A + aj z 

Since Ly(A) is continuous at 0, it follows that {X n } converges in distribution towards T. 
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8 ) The claim follows trivially from 

lim E{X n } = 2 lim - (l - -) = - = E{Y\. 

n—>oo n—>oo a V TlJ a 


fx(x) = 


Example 5.9 A random variable X has the frequency 

a e~ ax . x > o, 

0, x < 0, 

where a is a positive constant. 

1) Find for every n G N the mean E {X n }. 

2) Find the Laplace transform Lx{ A) of X and show that it is given by 

3) A random variable Y is given by U = kX, where k is a positive constant. Find the distribution 
function ofY. 

4) Let U and V be independent random variables of the frequencies 

( 2ae -2au , ^>0, ( 3ae _3av , ^>0, 

fu(u) = < fv(v) = < 

[ 0, u < 0, [ 0, v < 0. 

The random variable Z is given by Z = 2 U + 3V. 

Find the frequency of Z. 


1) We get by a straightforward computation, 


r 

E{X n } = / 

Jo 

2 ) If A > 0, then 


1 r°~ n ] 

are ~~ dx = — / t n e~ n dt=^. 

a n J o a n 


r c 

^x(A)= / 
Jo 


o -ax e -\x dx = 


■/” 


~(a+\)x dx = 


a + A i A 


If 0 < A < a, then 


= +AMA). 


A /AA 2 /A\ 3 /A n4 
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3) The distribution of Y for y > 0 is given by 

P{Y <y} = P{kX <y} = {x< |} = jf ‘ aa~ ax dx = 1 - exp (-£ y) , 


hence the frequency is 
a 


fy(y ) = < 


/c 


exp 


(-^y) for y >0, 


0 


for y < 0. 


4) It follows from 3. that 2U has the frequency fx{u), and that 3V has the frequency fx(v). (In the 
former case k = 2, and in the latter case k = 3). 

This means that 21/, 34^ G T ( 1, so 


z = 2 U + 3F € r ( i + i, IJ = r ( 2 , t), 
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5. the Laplace transformation 


and the frequency of Z is given by 


( a 2 z e az for z > 0, 
fz{z) = { 


0 for z < 0. 


Example 5.10 Given a sequence of random variables (X n )^ =1 , where X n has the distribution func¬ 
tion 


f 0 for x < 0, 


for 0 < x < 


1 


F n (x) = < 


n 


1 for x > 


1 


n 


1) Find for every n G N the mean E {X n } and variance V {X n }. 

2) Prove that the sequence (X n ) converges in probability towards a random variable X, and find the 
distribution function of X. 

3) Find the Laplace transform L n (X) of the random variable X n . 

Is the sequence of functions (L n ( A)) convergent ? 

4) Find the distribution function of Y n — X 2 . 

5) Assuming that the random variables X\ and X 2 are independent, we shall find the frequency of the 
random variable Z = X\ + X^. 

1) The frequencies are obtained by differentiation, 


0 for x < 0, 


f n ^x) = < 2n 2 x for 0 < x < — 


0 for x > —, 

n 


hence 



2 n 2 x 2 dx = 2 n 2 



and 



whence 
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2) If x < 0, then of course F n (x) = 0 —> 0 for n —> oo. 

If x > 0, then there is an TV, such that x > — for every n > TV, thus F n (x) = 1 for n > TV, and 

n 

F n (x) —> 1 for n —» oo. We conclude that (F n (x)) converges in distribution towards the causal 
distribution 

{ 0 for x < 0, 

1 for x > 1. 


3) If A > 0, then 


L n (X) = J e Xx f n (x) dx = 2n 2 / e Xx xdx = 2n 2 


f 


A 6 


—Ax 


2 n 2 
Jo + ~A~~ 


/ 


— Ax 


dx 


- . .. . 2n 2 

= -2„ •j iS -e*p|--J + T - 


— A 6 


— Ax 


2n / A\ 2n 2 , 

= — exp rJ + as- |1 -® p 


Then by a series expansion, 


r /\\ 2n f A 1 A 2 A 2 / A\ 1 2n 2 f / A 1 A 2 A 2 / A\ 

ira(A) “ ■T\ 1 “n + 2!^ + ^ £ ( v nJ/ + ^\ 1 “( v 1 “n + 2'^ + ^ £ ( v nJ 

2n A A /A\ 2n , o /A\ ^ A /A\ 

A n n \n J A \n/ n \n J 


and we conclude that L n ( A) —> 1 for A —> 0+ and n —> oo. 

4) If 7/ > 0, then 

P{r„ < y} = p{(X n ) 2 <y} = P{x n <Vy} = Fn(Vy), 


hence 


P{Y n <y} = < 


0 for y < 0, 


n 2 y for 0 < y < — 


for y > —. 


5) We first note that 

POO pi 

fz(z)= fi(x)f 2 (z-x)dx = 2 x-f 2 (z-x)dx. 

Jo Jo 


If fz{z) 0, then z — x G 




, thus x G [0,1] fl 


z F z 


In particular, fz(z) = 0 if either z < 0 or z > 
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If ze 


°y 


, then 


fz(z) = f 2x • 2 • 4 • (z — x) dx = 16 f ( zx — x 2 ) 
Jo Jo 


dx 


16 


x 2 x 3 


x=0 


16 ( — — — 
2 3 


^ 3 . 


if 2 e 


:,1 


, then 


[ 16 (zx — x 2 ) dx = 16 

x 2 x 3 

L-i 1 J 

Z 'Y~Y 


3 ^ 


1\ 16 f 1 

Z -2 Z + t ( Z -2 


8 q q 9 16 Q 9 2 2 

= - z 3 - 8 z 3 + 8z 2 — 2zH- z 3 - 8 z 2 -h 4z - - = 2z -. 

3 3 3 3 


Finally, if z G 


i, 


, then 


/z(-z = = f 16 (zx — X 2 ) 

J z— h 


dx = 16 


O Q -I 1 

or ar 


Summing up, 


161 yH '- 16 


zf _1 

2 \ 2 


16-1 


16 q o 16 q o 2 

= 82:-8z 3 + 8 z 2 -2z-\ - z 3 — 8 z 2 -h 4z - 

O OO 

8 q 

= — z 3 + IO2: — 6. 


/zW = < 


3 * 


2 z- 


for z G 


for z G 


-~z 3 -h lOz — 6 for z G 

o 


°4 


:,1 


4 


otherwise. 
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Example 5.11 Let X\, X 2 , ... be mutually independent and identically distributed random variables 
of values in [0, 00 [, and let L( A) denote the Laplace transform of JQ. 

Let N be a random variable, independent of all the Xi-erne and of values in No, and let P(s ) be the 
generating function of N. 

Let the random variable Y/v be given by 

Y n = X 1 +X 2 + -" + X n 

(where the number of random variables on the right hand side is itself a random variable). 

1. Prove that Y/v has the Laplace transform Ly N (X) given by 

L Yn (\) = P(L(\)), a > 0. 

Assume in particular that all JQ are exponentially distributed of parameter a, and let N be Poisson 
distributed of parameter b. 

2. Find in this special case Ly N (X), and the mean and variance ofYjy. 

3. Find also in this special case the distribution function ofY. 


1) We apply 

00 

(8) P{Y N <y} = J2 P i N = n}-P{Y n <y}. 

Then 


n=0 


L 


y n 


roo 7 poo 00 7 

(A) = / e~ Xv — P{Y N <y}dy= / V P{N = n} ■ — P {Y n < y} 

Jo ay Jo ^ ay 

= Y P { N = n } e ~ Xv fn{y)dy = ^2,P{N = n}[l e~ Xv f(y)dy) 

n =0 n=0 J 

00 

= £P{JV = n}(L(A))" = P(L(A)). 


dy 


n =0 


2) When Xi £ T ( 1, - ), then 


L{ A) = 


A T a 

When G P(b ), then 
P(s) = exp(6{s — 1}). 

Then it follows from 1. that 

p y n (Y) = P(I/(A)) = exp ( b 


X T a 


1 = exp l-b ■ 


X T a 
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Since 


L Y N W = ~ /X 6 a .A 9 eX P (~ b ■ X 


(A + a) 2 


A + a ’ 


we get 




From 

^(A) = 

follows that 


ba 


(A + a) s 


exp ( —b 


A 


A + ay (A -|- a) 


e{x 2 } = l'± n ( 0) = 5 + §> 

and we conclude that 


26a / A 

exp I —6 


A + a 


mi = S- 


3) This question is underhand, because one is led to consider Ly N ( A), which does not give easy 
computation. We shall instead apply that if y > 0, then 

oo 

G(y) = P{Y <y} = P{N = 0} + ^ P{N = k} ■ P {*! + • • • + X k < y} . 

k=l 


qaiteye 
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We see that G(y) has a jump at y = 0 of the size 
P{N = 0} = e~ b , 

and that G(y) for y > 0 is differentiable with the derivative 

oo 

G\y) = fv n (y) = J2 p {N = n}- f Yn (y). 

n =1 

Since N G P(6), we get 
h n 

P{ N = n}= — e~ b . 

n\ 

Since 

j =1 ' 


we get 


fY n {y) = 


y n-% e -a V 


(n — 1)! 

Hence, Y has a jump at y = 0 of the size e ~ b , 


<?(>) = />■»(») = E^r 


-6 


^ n! (n — 1)! 


re 


and if y > 0, then 

-ay 
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Example 5.12 Let X\, X 2 , X 3 , ... be mutually independent random variables, all of the distribution 
given by 

p {Xi = k} = e~ a , keN 0 ; i e N 
(here a is a positive constant). 

Let N be another random variable, which is independent of all the X{ and which has its distribution 
given by 

P{N = n} =pq n ~ 1 , ne N, 
where p > 0, q > 0 , p + q = 1 . 

1. Find the Laplace transform L( A) of the random variable X\. 

2 . Find the Laplace transform of the random variable Y^=i n £ N. 

3. Find the generating function P(s) of the random variable N. 

We introduce another random variable Y by 

(9) Y = X 1 +X 2 + --- + X N , 

where N denotes the random variable introduced above, and where the number of random variables on 
the right hand side of (9) is also a random variable. 

4. Prove that the random variable Y has its Laplace transform Ly{ A) given by the composite function 

Ly( A) = P{L{ A)), 

and find explicitly Ly( A). 

Hint: One may use that we have for k E No, 

00 

P{Y = k} = J2 P i N = n} ■ P {X 1 + X 2 + ■ ■ ■ + X n = k} . 

n— 1 

5. Compute the mean E{Y}. 


1) The Laplace transform of X\ E P{a) is given by 


°° rL 




—a —k A 


k =0 


_ a ^ 1 / _x\k exp (ae A ) / r -a 

= e y -- (ae x ) = - K J = exp (a {e A - l}) 

^ k\ v ’ exp(a) v L }) 

k =0 J 


2) The Laplace transform of is given by 

{L( A)} n = exp (na {e _A — l}) . 
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3) The generating function for N E Pas(l,p) is found by means of a table, 


P(s) 


ps 

1 — qs 


Alternatively, 


P(s) =pJ2q n -h n =psJ2(qs) n - 1 = 

El El 1 - ^ 


4) It follows from 

oo 

P{Y = k} = J2 p i N = n}-P{X 1 +X 2 + ---+X n = k}, 

n— 1 

that 

oo oo 

Ly( a) = ^^P{A^ = n}-P{Xi+X 2 + --- + X n = fc}- e - fcA 

k= 0n=l 

oo oo 

= ^P{AT = n}^P{X 1 +X 2 + --- + X n = fc} e - Afe 

=- A -l)) 


n=l 

oo 


fc =0 


^P{AT = n}-( J L(A))" = P(L(A)) = I 


p • exp (a (e 


n=l 


— q • exp (a (e A — 1)) 

p q • exp (a (e _A — l)) —1 + 1 p 1 p 

q 1 — g • exp (a (e -A — 1)) q 1 — q • exp (a (e -A — 1)) q 


5) Since 


L' f (A) = 


Q {1 — q exp (a (e -A — 1))} 


q exp (a (e A —1 ))-ae A , 


the mean is 


£{X} = —Ty (0) = 


pa pa a 


(1 — g) 2 p 2 p 
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Example 5.13 Let Xi, X 2 , X 3 , ... be mutually independent random variables, all with the frequency 

{ 4x e~ 2x , x > 0, 

0 , x < 0. 

Let N be another random variable, which is independent of all the Xi, and which has its distribution 
given by 

3 /l\ n_1 

P{N = n} = -f-j , ne N. 

1. Find the Laplace transform L( A) of the random variable X\. 

2 . Find the Laplace transform of the random variable Y^i =1 Xi, n G N. 

3. Find the generating function of the random variable N. 

Then introduce a random variable Y by 
(10) Y = X 1 +X 2 + ---+X N , 


where N denotes the random variable introduced above, and where the number of random variables on 
the right hand side in (10) also is a random variable. 

4. Find the Laplace transform ofY and the mean E{X}. 

5. Prove that the frequency ofY is given by 

( k{e~ y — e~ 3y }, y > 0, 

g(y) = { 

{ 0, y < 0, 


and find k. 


1 ) 


Since IgT 



get by using a table that 


L(X) = 




Alternatively, 




dx = 4 



Xe ~ {x+2)x dx 


4 

(A + 2p' 


2) Since the Xi are mutually independent and identically distributed, the Laplace transform of 
TJi= 1 Xi: n e N, is given by 
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3) Since N E Pas( 1, - ), we get from a table that the generating function is 


P(s) 


3s 


1- is 4 — s' 


Alternatively, 

Q OO / -I \ Tl 1 

**>■ V 


4 ^ V4 

n=l 


s"-- 
“ 4 


n—1 — 


s(5)-i 


n= 1 


3s 

4-A 


4) The Laplace transform of T is given by (cf. e.g. the previous examples) 

2 

12 


LA A) = P{L{\)) = 


A T 2 


4(A + 2) 2 — 4 


A + 2 y 

3 1 3 1 


(A T 1)(A T 3) 2 A + 1 2AT3 
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Now, 


L'A A) 


3 13 1 

2 ' (A+ l) 2 + 2 ' (A + 3) 2 ’ 


so the mean is 


= -l' y (0) = 1-1-1 


3 _ 1 
2 _ 6 


4 

3 


5) Since g(y ) is the frequency of some random variable Y , where 

/>oo />oo 

iy(A) = k {e~ y -e- 3 y }e~ 2y dy = k / e“ (A+1)!/ dy 

Jo Jo 

(— 1 -—l 

\ A + 1 A + 3 / 


= k • 


rOO 

k / e“ (A+3)y dy 

Jo 


has the same structure as Ly(A), we conclude from the uniqueness that Y = Y and that k = 

3 

and the frequency of Y is g(y) with k = 

Test: 

I °° S(y) d v = k f™ i e ~ v - e_3 d ^ = = = i 

for k = 0 
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Example 5.14 Let X be a normally distributed random variable of mean 0 and variance 1. 

1. Find the frequency and mean of X 2 . 

2. Find the Laplace transform of X 2 . 

Now let Xi, X 2 , ... be mutually independent random variables, Xi E N(0, 1 ), and let a\, 02 , ... be 
given constants, and define 

n 

Y n = ^2 a k x k, neN. 
k =1 

3. Find the Laplace transform ofY n . 

4. Prove that the sequence [Y n }^ =1 converges in distribution towards a random variable Y, if and 
only if 

lim E {Y n } < 00 . 

n—>00 


By the assumption the frequency of X is given by 


<p(x) = 


1 


,_ exp — - x 

V^r V 2 


1 


x E . 


1) The distribution function of Y = X 2 is 0 for y < 0. 

If y > 0, then 

P {x 2 < q = P{-Vy < x < Vy} = $(Vy) - $ (-Vy) = 2$ (Vy) - 1. 
When y > 0, the corresponding frequency is found by differentiation, 

1 


f(y) = 2 4> / (Xy) • ^ p (Xy) = ^ exp 

The mean is 


V 


E{x2} = 

’ +v/° 

00 v27T J — c 


r °° , ( ( 1 2 
rd - exp \ —-x 


—x exp [ — - x 


exp ( — - x 2 ) dx = 0 + 1 = 1. 


2) Since X 2 > 0, we can find its Laplace transform. If A > 0, then 


ix,(A> = L ^ ew {~l v ) eM ~ xv)dy= ^l exp (“K A+ 5) !, )‘ !( ^ > 


V 27 r 


r°° (if 

/ eXp _ 2~ 
do V 2AH 


2 

2A+1 


dt = 


V2A + 1 


Nr /_p xp H (2A+1) * 2 ) dt 


V2A +1 ‘ 
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3) 


We get the Laplace transform of aX 2 = aY\ from Lx( A) by replacing A by aA, i.e. 

LaX\X) = L x ,{a\) = -=L=. 

V2Aa T 1 

Now, the Xk are mutually randomly independent, so 


lya a )= n L ak xiw= n m 

k= 1 k=1 


1 

VnLi + 2Aa /c ) 


4) We get by using the result of 1., 

n oo 

E{Y n } = Y j a k E{Xl} = Y j a k , 

k= 1 fc=l 

thus 

oo 

lim E 1 {K„} = W a fe . 

n—> oo z —' 

k=l 

Then we get for A > 0, 

n n n 

In na + 2A ak) — 'y ] la (1 + 2A a&) — y ^ (2Aa^ + Aa^e (Aa&)), 
fc=i fe=i fe=i 

where we by considering a graph can get more precisely that 

n n 

0 < In (1 + 2A a^) < 2A a/e, 

fe=i fe=i 

and 

oo oo 

H ln (l T 2Aa&) ~ ^ ^ 2Aa/c. 
fe=i fe=i 

It follows from the equivalence of the two series that 

oo oo 

1 < JJ (1 + 2A a/e) < ex), if and only if a/e < oo. 
k =l fe=i 

If therefore 

lim £{T n } < oo, 

n—> oo 


then in particular lim n ^ 00 {—Ly (A)} is convergent and continuous for A > 0, hence by rewriting 
the expression, followed by a reduction, YlkLi a k < oo, which according to the above implies that 


lim Ly n (A) 

n—> oo n 


1 

VlIfeLi (! + 2A a/e) 


is continuous for A > 0. Then (Y n ) converges in distribution towards a random variable Y. 
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Conversely, if lim n ^oo E {Y n } = oc, then we get by the same argument that YlkLi a k = 00 implies 
that rifcLi (1 + 2A a/c) = 00 for A > 0, and of course 1 for A = 0, hence 


lim L Yn { A) = 

n—>oo 


1 for A = 0, 

0 for A > 0, 


corresponding to the zero function, which is not the Laplace transform of any random variable. 
This shows that (X n ) does not converge in distribution. 


Example 5.15 We say that a function ip : ]0, oo[—> M is completely monotone, if ip is a C°° function, 
and 

(— l) n ip( n \\) > 0 for every n E No and every A > 0. 

Prove that if X is a non-negative random variable, then the Laplace transform L( A) of X is completely 
monotone. 


Remark 5.1 Conversely, it can be proved that if ip : ]0, 00 [ —> M is completely monotone, and 


Aa^o+^(/\) — 1, 

then (p( A) is the Laplace transform of some random variable X. 



360 ° 
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When X is non-negative, its Laplace transform exists, and 

1) L( A) = '^2 i Pie ~ Xxi , (discrete), 

2) L( A) = J 0 °° e~ Xx f(x) dx, (continuous), 

3) L( A) = E {e _A:r } , (in general). 

Due to the exponential function and the law of magnitudes we may for A > 0 differentiate 1) under 
the sum, 2) under the integral, and 3) under the symbol E, with respect to A. Hence we get in general 
[i.e. in case 3)] for A > 0 and n E No, 

(_!)«!>)(A) = A n E {X n e~ xx } . 

Since X n e~ xx > 0, the right hand side is always > 0, and the claim is proved. 

Clearly, 

L( 0) = lim L( A) = lim E{e~ xx \ = E{ 1} = 1, 

A^0+ A^0+ L J 


and 


0 < L(A) = E {e _AX } < £{1} = 1, 
because 0 < e~ xx < 1, nar X > 0. 

A loose argument shows that the last claim follows from the fact, that if (—1) n ip( n \\) > 0 for all 
n E N, then we get in e.g. the continuous case that 


L 


oo 


e Xx x n f(x) dx > 0 for all A > 0 and all n E No, 


thus 

x n f{x) > 0 for all n E No and x > 0, 
and hence f{x) > 0. Finally, 



lim ip(X) = 1. 

A^0+ 
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Example 5.16 A random variable X has the values 2, 3, 4, • • • of the probabilities 
P{X = k} = {k- l)p 2 (l-p) k - 2 , 
where 0 < p < l, thus X G Pas(2,p). 

1. Find the generating function and the Laplace transform of X. 

2. Find the mean of X. 

2 3 4 

Given a sequence of random variable (X n )°f_,, where X n has the values —, ... of the probabil- 


n n n 


ities 



3. Find the Laplace transform of X n . 

4. Prove that the sequence (X n ) converges in distribution towards a random variable Y, which is 
Gamma distributed, and find its frequency ofY. 

1) The generating function of X is given by 


oo 


oo 


P(s) = = = l)p 2 (l-p) k ~ 2 s k 


k =2 


k =2 k=2 


k=2 


oo oo 


= P 2 s 2 - !){(! - P)F ~ 2 = P 2g2 Y n(! - P>Y~ % 



for s G [0,1]. 


Then by a simple substitution, 



2) Here there are several possibilities, of which we indicate four: 

First variant. It follows from 


p, ( X = 2 PI {1 - (1 - p)s}p + p(l - p)s 

U 'l-(l-p) S ' {l-(l-p) s }2 


that 


E{X} = P'( l) = 2-l-4 = -- 

P Z P 
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Second variant. It follows from 

V(A)=p 2 (-l){e A -(l-p)}" 3 -e A , 

that 

E{X} = —1/(0) = % = -■ 

P 6 P 

Third variant. By a straightforward computation, 

oo oo 

E{X} = '£kP{X = k} = ^k(k-l)p 2 (l-p) 

2 


k -2 


k =2 


k =2 


= V 


j2k(k-i)(i- P ) k ~ 2 = 


P 2 


k =2 


{l-(l-p )} 3 


2 

V 


Fourth variant. (The easiest one!) Since X G Pas(2,p), er have of course E{X} = 

3) If we put p = —, then nX n has the same distribution as X. Now, X n is obtained by diminishing 
3 n 

the values by a factor —, so X n has the Laplace transform 
n 


Lx n W = 


3 n 


l 


eX/n ~ (1 - ak) 


3 n ( exp ( — ) — 1 


M 


2 * 


4) It follows from 


/A\ A A /A 

exp — ) = 1 H-I— ^ ( — 

V nJ n n \n 


that 


i.v.(A) = 


{ 3 „C + ^(^) + l} ( 3 A + 3Ae (—) + 1 

( \n n \n J J J ( \n J 


(3A + l) 2 


for A > 0. 


Clearly, the limit function is continuous, so it follows that the sequence (X n ) converges in distri¬ 
bution towards T, where Y has the Laplace transform 


Ly( A) = 


A > 0. 


(3A + l) 2 5 

If Y G r(/i, a), then its Laplace transform is 

1 

(ax +1 y 

Then by comparison a = 3 and p = 2, so Y G T(2, 3), and Y has the frequency 


f(y) = 


(- 1 ). 


g V exp ( — — 


0, 


y > o, 
y < o. 
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Example 5.17 A random variable X has the values 0, 2, 4, • • • of the probabilities 
P{X = 2k}=p(l-p) k , ke No, 
where p is a constant, 0 < p < 1. 

1. Find the Laplace transform Lx{ty of the random variable X. 

2. Find the mean of the random variable X. 

oo 2 4 

A sequence of random variables (X n )°°_-, is determined by that X n has the values 0, ... of the 

n n 

probabilities 


2 k 


i V 


P { X -=~n] = rn{ 1 -^) ’ 

3. Find the Laplace transform Lx n { A) of the random variable X n . 

4. Find the mean of the random variable X n . 

5. Prove that the sequence (X n ) converges in distribution towards a random variable Y, and find the 
distribution function of Y . 


1) The Laplace transform is 

oo oo 

L x ( A) = = 2fc}e- 2A * = 5>(l-p) fe e- 2Afe 


k =0 
oo 




k=0 

k p 


k =0 


(1 — p)e~ 2X ’ 


A > 0. 


2) The mean can be found in two ways: 
a) By the usual definition, 

oo oo 

E{X} = ]T 2kp(l - p) k = 2p(l - p) Y, H 1 - pf- 1 = 2p(l - p) 4 “ 2 

ti P P 


1 1 ~ P 


b) By means of the Laplace transform, 


E{X } = -L' x ( 0) = 


{1 — (1 -p)e-^Y 


2(1 — p)e 


-2A 


2p(l - p) = 2 1 ~P 


J A=0 


3) The Laplace transform of X n is obtained from the Laplace transform of X by replacing A by —, 

1 U 

and p by —, 

4 n 


Lx n (^) = ' 


1 

4n 


1 


L -' I' 1 “^) exp (“ 2 k) 4n ( l - exp (-1))■+ exp (“ 2 £ 
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> exp 


2A 


n J n 


2 ( 2A 

exp 


4n ( 1 — exp ( — 2 — j j + exp f—2 — 


)}' 


4) Since 

-L'xA A) = 

we get the mean 

£ OT = -Luo) = ^-{8-?}=8(i-i). 

5) Then by a Taylor expansion, e l = lOt + te(t), so it follows from 3. that 

L x n (A) = 


„ r , 2A 2A /2AA 

4n < 1 — 1 H-f-^ I — 1 


1 


8A + 1 


n n \ n J 
for n —» oo. 


} +ex »t 2 i) 


8A + 8A e ( — ) + exp 


—2 — 
n 


8A + 1 


hence 


Since —--- is continuous, this shows that (X n ) converges in distribution towards a 

8A + 1 

i 

variable Y, where the Laplace transform of Y is Ly(A) 

v g r(i,8). 

Thus the frequency of Y is 

iexp(-|), „>0, 


random 


fv(y) = < 


o, 


y < o, 


so we have obtained an exponential distribution. 
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6 The characteristic function 

Example 6.1 Find the characteristic function for a random variable, which is Poisson distributed of 
mean a. 

It follows from 

k 

P{X = k}=e~ a , k € No, 
that the characteristic function for X is given by 

00 f] k 00 i , 

k(u) = Yi,e iuik ~jj e ~ a = e ~ a J2w {° e / = e ~ a exp (ae“) = exp (a (e iu > - l)). 

k=0 ' k=0 K ' m 


SIMPLY CLEVER 


5KODA 



We will turn your CV into 
an opportunity of a lifetime 


Do you like cars? Would you like to be a part of a successful brand? 
We will appreciate and reward both your enthusiasm and talent. 
Send us your CV. You will be surprised where it can take you. 


Send us your CV on 

www.employerforlife.com 


85 




Click on the ad to read more 


Download free eBooks at bookboon.com 















Analytic Aids 


6. The characteristic function 


Example 6.2 Let X have the frequency 

( i- M, M < i, 

/(*) = { 

{ o, M > 1. 

Find the characteristic function for X. 

Let X\ and X 2 be independent random variables, which are rectangularly distributed over 
Prove that X has the same distribution as X\ + X 2 , 

1) by a straightforward computation of the frequency of X 1 + X 2 , 

2) by using characteristic functions. 


The characteristic function for cu 7 ^ 0 is 


/ oo pi 

e lut f(t) dt= { 

-OO J -1 


= 2 


— (1 — x) sincux 


UJ 


cos cjx + i sincjx 


— / sin (wx dx = — 


}(1 — \x\) dx = 2 f 

Jo 


c 0 


/ ^ 


c 0 


COS LUX 


1 1 


i0 


If w) = 0, then fc(0) = 1. 

1 ) The frequency for both X\ and X 2 is given by 


cos (wx • (1 — \x\) dx 
2 

—R (1 - coscj). 


m 


1 for t G 


1 1 " 

2’2 5 


0 otherwise, 


hence the frequency of X\ + X 2 is given by 
g(s)=f f(t)f(s-t)dt= f f(s — t) dt. 

J -00 J -i 

If s £ ] — 1 , 0 [, then g(s) = 0 . 

If s G ] — 1, 0], then 

ri r s +h 

g{s) = / f(s — t) dt = / 1 dt = s + 1 = 1 — \s\. 


If s G ]0,1[, then 

1 

f(s — t) dt = / 1 dt = 1 — s = 1 — |s|, 

and the claim follows. 
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2) If uj ^ 0, then we get the characteristic function for Xy, 




' 2 

2 1 


cu 2i 

Hence, the characteristic function for X\ + X 2 is 


rw \i2 4.2^ 4 

{/l(w)} = ^ sm 2 = ^ 


1 — cos cj 2 
-o- = 7X (1 -COSCJ) 




Since X and Xi + X 2 have the same characteristic function, 


= k(Ui)). 

they are identical. 


Example 6.3 Let X have the frequency 

f{x) = 7 2 , —27- x G M, 

7 r (a 2 + x 2 ) 

where a is a positive constant. 

Prove by applying the inversion formula that X has the characteristic function 

k(u) = e“ a H 

Then prove that if X 1 , X 2; ..., X n are mutually independent all of the frequency f(x), then 

Z n = -(X 1 + ---+X n ) 

n 

also has the frequency f(x). 


When we apply the inversion formula on k( cu), we get 


i poo 1 p 0 1 /*o 

— / e -^e“ a|a -’ 1 du = — e (a ““ )uJ duj+— e -(«+«V cL; 

2?r J.oo 2 tt 2tt 


' —OO 

1 

27r 


g(a—zcc)u; 


a — ix 


1 

+ 2^ 


1 a + ix + a — ix 
27 t a 2 + x 2 


e — (a+ia?)u; 

a — ix 
a 


—00 

1 / 1 


+ 


1 


27t V a — ix a + ix 


a 2 + x 2 7 r (a 2 + x 2 ) ’ 

and the claim follows from the uniqueness of the characteristic function. 


The characteristic function for 

Y n = - (X! + ---+X n ) 
n 

is 


*v.H=n*-<o-n» p (-“l^l)=^ H 

i= 1 i =1 

showing that Y n has the same frequency as X. 


kx (^), 
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Example 6.4 Let X\, X 2 , ... be mutually independent, identically distributed random variables all 
of mean pi. Let 

Z n = — (Xi + • • • + X n ), n E N. 
n 

Prove that the sequence (Z n ) converges in distribution towards fi. 

Given fi = E{X} exists, we must have the following 

/ oo 

\x\ f(x) dx < 00 , 

-00 

which shall be used later. 

Let k{u) denote the characteristic function for JQ. Then the characteristic function for Z n is given by 

= (;)}"• 

It follows from (11) that 

/ OO POO 

e lujx d(x)dx and k'(cj) = i / e luJX x f (x) dx 

-00 J — 00 

are both defined and bounded. 
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It follows from 


/c(cu) — /c(0) T ^ / (^) ^ T ^ £(cu) — \ i jl ' (jJ ~\~ id £(cu), 


that 


^n(^) — 


M 3}"4 


l L1UJ ijJ fUJ 

-1-£ ( — 

n n \n 


= I 1 + - 

n 


{i^+^0} 


Hence, by taking the limit, 
lim k n (uj) = e* Mu; , 


which is the characteristic function for the causal distribution /i. 

In particular, e z/xa; is continuous at uj = 0. Hence it follows that the sequence ( Z n ) converges in 
distribution towards fi. 


Example 6.5 Let X have the mean 0 and variance a 2 . 

Prove that 

k(uj) = 1 — - ct 2 uj 2 + uj 2 £(cj) for uj —> 0. 

Then prove the following special case of the Central Limit Theorem: 

Let Xij 2 ; • • • mutually independent, identically distributed random variables of mean 0 and variance 
a 2 . Define 

Z n = ~ cr 0^1 + ‘ ‘ * + X n ) , n G N. 

TTien for every z G M, 

P {Z n < —> 3>(z) for n — > 00 . 


We see that 

= I-o o e iwx f(x) dx, 
k('u>) = J£' oo e ia ’ x ixf(x)dx, 

k"(u >) = — jP xj x 2 e lux f(x) dx, 


are all absolutely convergent, and 


fc(0) = 1, 



x /(x) dx = i pi = 0, 


/ OO /»OG 

x 2 f{x) dx = — (x — fi) 2 f(x) 

-00 J —00 


dx = cr 2 , 


hence by a Taylor expansion, 


fc(u;) 


fc(0) + — .'(0) CJ + — fc"(0) cu 2 + cj 2 £( cj ) 

a 2 u; 2 2 

1-— e(u). 
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The characteristic function k n (uj) for Z n is given by 


= £{e“ z "} =£ jexp \ = J] £ <> exp (X, 


k =1 


= E 


■{-(&*)})*• 


where 




| = J exp ^'iuj ^j— ] f(x) dx = k ^ U 


cryjn 
,2 , ,2 


yjn 




a 2 uJ 2 (jS 2 I uj 


2 cr 2 n a 2 n \<j^/n 


1 CcT co* ( (jJ 

= 1-* - 7 T H -£ ( —7= 

n 2 cHn V ovn 


Hence by insertion, 


f cr 2 a; 2 cu 2 ( ijj \ 1 cu 2 cu 2 / uj 

kn{w) = Si- ~ -o-1-o 5 ( -7= ) = --9 5 

[ 2 (j z n cr z n \(jy/n 1 ” 9 rrZr 


n 2 cr 2 n V cr\/n 


exp ( —— ) for n —> oo. 


Now, exp is the characteristic function for <f>(x), so we conclude that (Z n ) converges in 

distribution towards the normal distribution, 

lim P {Z n < x} = $(x). 
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Example 6.6 1) A random variable X has the frequency 

1 


f( x ) = 


x e R. 


7T (1 + X 2 ) ’ 

Prove by e.g. applying the inversion formula that X has the characteristic function 
k(w) = e" M . 

2) A random variable Y has the frequency 
a 


g(y) = 


ye¥L, 


Tr(a 2 + (y- 6) 2 )’ 
where a > 0 and b E M. Find the characteristic function for Y. 

3) Let ( Yj ) be a sequence of mutually independent random variables, where each random variable Yj 


has the frequency 

9j(y ) = 


y € M, 


( a j + (y- bp) 

where aj > 0 and bj E M, and let Z n denote the random variable 

n 

Zn = Y, Y r 

3 = 1 

Find the characteristic function for Z n . 

4) Find a necessary and sufficient condition, which the constants aj and bj must fulfil in order that 
the sequence (Z n )^ =1 converges in distribution. In case of convergence, find the limit distribution. 


1) It follows by the inversion formula that 


-I POO i rO i POO 

— duJ= _ g(l -ix)u duJ+ _ e -(l +ix )^ dw 

7-00 27r J-u, Jo 

If 1 l 1 \ 

2tt \ 1 — ix 1 Fix ) 


’ — OG 

1 

27r 


e (l —ix)u> 


1 — ix 


1 

+ — 


e —(1 +ix)u; 


j-u 2tt G(1 + “)Jo 
1 1 + ix + 1 — ix 1 1 

27r 


= f(x)- 


1 + X 2 7T 1 + X 2 

This shows that fc(u;) = is the characteristic function for 

«*>-;■ TT3*- 


2) The characteristic function for T is 

1 a 


ky{aj) 


I 

J —( 


7r a 2 + (y — 6) 2 


dy = e 


OO 

,iujb I m _ 


7 

J —c 


7r a 2 -\- y* 


dy 


POO 

Aujb I A aoj- - y 1 

° 1 ^ a . — 


7 

-7 —c 


1 


(!) 


- d = e tujb k(auj) = 


- b -a\u\ 
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6. The characteristic function 


3) It follows from 2. that 


kz n {u) = ]^[ k Yj (v) = ]^[ e lu;bj • e aj|a;| = exp 1 iuj^bj 1 • exp I -|cj| 


3 = 1 


3 = 1 


J = 1 


J = 1 


4) The sequence (Z n ) converges min distribution if and only if lim n ^ 00 kz n {oS) is convergent for all 
c j with a limit function h(u), d which is continuous at 0. 

Clearly, the only possible candidate is 

h(u}) = exp - exp ^-|w| . 

It is in fact the limit function, if the right hand side is convergent for every wGi This is fulfilled, 
if and only if 


(12) a n = a and b n = b 

n=1 n=1 

are both convergent. When this is the case, then 
h(u>) = e iub e~ aM =k Y (u) 

by 2.. 

This shows that (Z n ) converges in distribution towards a random variable Y, if and only if the 
series of (12) are convergent, and when this is the case, the frequency of Y is 


1 


fr(y) = - 


7r a 2 + (y — b) 2 ’ 


|/Gi 
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Example 6.7 Let X\, X 2 , ... be mutually independent random variables, where 


p{x j = Jj)=p{x j = -Jj} = 1 -, j e N, 

and let 

1 n 

Z n = - y^Xj, ne N. 
n 

3 =1 

Prove that the sequence (Z n )^ =1 converges in distribution, and find the limit distribution 

1) either by applying the Central Limit Theorem; 

2) or by computing lirr^^oo k n (uj), where k n (uj) is the characteristic function for Z n . 
Hint: Use that 


cos x = 1 - %- + %- + x 4 e(a?) 

2 24 v ' 

and 

x 2 

— ln(l — x) = x + — + x 2 e(x) 


for x —> 0 


for x —> 0. 


1) From E {Xj} = 0 follows that 
n i=i 

and 

4 = V{Z n } = T^ F{X . } = _L^^{ X 2 } _ (jB{Xj}) 2^ = 


n 

= 4 e 

n 2 ^ 
j=i 

Now, 

Zn — E {Zn} 


J=1 

2 1 


J = 1 


J = 1 


(-v5) 2 i} = ^Ei = 45" (n + 1> = 5 

j = l 


1 n + 1 


n + 1 V n + 1 


2n 




so by the Central Limit Theorem, 

= 4>(x) for every x G M. 


lim P { Z n < x 

n—>oo 


n + 1 


2n 


We get from 


n+1 1 f fV , f 

—= lor n -mx) that 


2 n 42 

Fz(x) = lim P {Z n < x} = $ (V2 ■ x] 

n—> 00 V / 

hence Z = -^= F, where F G 7V(0,1). 
v 2 
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2) It follows from 

kz n (u) = n ^ {e X p X,) } = n {i eX p V 7 ) + ^ exp (^ (- V7 


3 = 1 
n 

n 

3 = 1 


j = l 


. V7 

cos I — CJ 
n 


by taking the logarithm and using the Taylor expansions given in the hint, 


In kz n (cu) = In ( cos ( —- ( 


j=i 


|>H(^ 


a; \ 2 1 /\/J • 4 


Vj- 


- W1 J1 j j 2 A J 

-Z> i 1 “T'^ + 24 '^ £ 


J = 1 


24 V n ) \ n 

2 x Vj-^ 


Vj- 


rr 


n 


■£{( 

.7 — 1 k V 


J 1 j UJ 4 j 2 Cj 4 j 2 ^ VJcj 

^-o 7TT ' /i h -“^ 


1 (u 2 j 2 CJ 4 j 2 CJ 4 j 2 UJ^J 

T r» l r» * A r\ i A + A & 


A,2 A,/7\\^ CJ 4 j|2 


2 V 2 n 4 24 n 4 




n 


+ 


E uj 

2rV ' J 


cu 


4 n 


3=1 


24 n 4 


j=i 


V - -2 1 /*\ 1 ^ 4 A .2 1/1 

+ n £ (n) + 24V^ J + V £ (v 


J = 1 


n \n 


uj 2 1 1 ( 1 \ cj 2 1 (l 

2 n 2 2 n \n J 4 n \n 


1 / CJ 

‘2 V72 


Hence, 


— ( —^ I for n —> oo. 




for n —> oo. 


If y is normally distributed, then of course 
k Y {oj) = exp > 

and thus 
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Example 6.8 A random variable X has the frequency 


f(x) = < 


1 1 — COS X 


i r x* 


x ^ 0 , 


1 

27T ’ 


x = 0. 

1. Prove by using the inversion formula that X has the characteristic function 

i - M, \u\ < 1, 

o, H>i. 


/c(cj) = 


2. Prove by e.g. using the result of 1. that X does not have a mean. 

Let (X n )^ =1 be a sequence of random variables, where each X n has the frequency 

1 1 — cos nx 

n G N. 

x = 0, 


f n (x) = nf(nx ) = < 


7r ra 


2 ’ 


n 

l 27T ’ 


3. Find the characteristic function k n (uj) for X n . 

4. Show, e.g. by using the result of 3. that the sequence (X n ) converges in distribution towards a 
random variable Y, and find the distribution function ofY. 


1) According to the inversion formula we shall only prove that 
L r e~ ix “k(u)du = f(x). 

J — OO 

Now, 1 — |cj|, \w\ < 1, is an even function, hence by insertion, 

f e~ ZXUJ k(uj) duj = ^- [ e~ lxuJ (l — \uj\) dx = — [ (1 — uj) cosuj x duo. 
J —oo J —1 7T </0 

We find for x = 0, 

0). 

If x ^ 0, then we get by partial integration, 


\ / (i-^) 

71 Jo 


— Uj) cos uj x dx = — 


(1-u) 


smur 


7r 

1 — COS X 
7T X 2 


X 

= f( x ), 


— [ sin uj x dx = — 

7T X Jq 7XX 


cos a; x 


and the claim is proved. 
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2) We know that if E{X} exists, then k{uf) is differentiable at 0. 

Since, however, k(u) is not differentiable at uj = 0, we conclude by contraposition that E{X} does 
not exist, so we conclude that X does not have a mean. 

3) Then by a simple transformation, 


(^) 


/ oo poo 

e iux f n (x)dx = / e ia>x f(nx) 

-oo J —u> 

\w\ < n, 


ndx 


1 - 


M > n. 


f exp (i — t\ f(t ) dt = k 
J —oo \ n J 



4) It follows from 3. that 

lim k n ((j) = 1 = ko(u) for ethvert cu G M, 

n—»• oo 

where fco(cu) = 1 is the characteristic function for the causal distribution P{T = 0} = 1. 

Since ko(uj) = 1 is continuous, it follows that (X n ) converges in distribution towards the causal 
distribution Y. 



ACCREDITED 


Excellent Economics and Business programmes at: 


university of 
groningen 


A 


AACSB 


I ill 

“The perfect start 
of a successful, 
international career.’ 


www.rug.nl/feb/education 


CLICK HERE 

to discover why both socially 
and academically the University 
of Groningen is one of the best 

places for a student to be 


96 

Download free eBooks at bookboon.com 







Analytic Aids 


6. The characteristic function 


Remark 6.1 In Distribution Theory , which is a mathematical discipline dealing with generalized 
functions, one expresses this by (/ n ) —> 5, where S is Dirac’s S “function”. 0 


Example 6.9 A random variable Y has the frequency 

/(!/) = | e"°'£ yeM, 

where a > 0 is a positive constant. 

1. Find the characteristic function for Y. 

2. Find the mean and variance ofY. 

A random variable X has the values ±1, ±2, ... of the probabilities 

P{x = k} = P{X = -k} = lpq k ~ l ) keN, 


where p > 0, q > 0, p + q = 1. 

3. Prove that the characteristic function for X is given by 
p{ cos a; — q) 


k 


x 


H = y 


+ q 2 — 2q cos uj ’ 


uj e 


Then consider a sequence of random variables (X n )<ff/ ty , where X n has the values =b — t 
the probabilities 



4. Find by using the result of 3. the characteristic function k n (uj) for X n . 

5. Prove that the sequence (X n ) converges in in distribution towards a random variable Z, and find 
the frequency of Z. 



1) The characteristic function is 

/ °° n n n C°° 

e iuj v ■ - ■ e ~a\v\ dy = - / e^ a+iu,)y dy + - e ^ a+i ^ v dy 

-oo 2 2 J_ 00 2 J o 


~ e (a+iuj)y " 

0 

a 

~ e (-a+iuj)y " 

oo 

- - 1 

( 1 | 1 > 

i _ 

a T i uj 

— a Y i uj 

0 

2 ' 

^a + iuj a — ioo ) 

' a 2 + uj 2 


2) By the symmetry, E{Y} = 0. The variance is then 

nn= £ in = | % £ £ «v <**££■ 
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3) The characteristic function for X is 

oo 

k x M = ^P{X = -fc} 


— ikuj 


Y J P{X = k}-e i 


k oo 


k=l 


k =1 
oo 


fE^M^T + fE^ 1 ( e *T 

/c=l /c=l 

oo oo 


\k V 


p e L 

■777 + ~ 


k=l 


k=l 


2 1 — q e~ luJ 2 1 — qe l 


= p Re 


(- 5^71 

\ 1 — g e zu; \ 1 


- 


ge- 


= pRe 


e LUJ — q 


} = r 


p(coscj — 1 ) 

1 — 2 g cos (j + q 2 j 1 + q 2 — 2q cos uj 


4) We put p = — and q = 1-—. The characteristic function for X n is obtained by replacing uj by 

3 n 3 n 

UJ 

—, thus 
n 


kniyj) — 


l ( UJ ^ 1 

-- cos- 1 + — 

3 n \ n 3 n 


i+U-tH — 2(1 — 7— 
Sn 


-h) c ° s Q 


n e N. 


5) It follows by insertion of 

2 n 2 + n 2 ~ Vn 


a; 1 w 2 (j 2 /cu\ 

COS =1 7 • 7 H- 7 £ ^ —J 


n 


that 


^n(^) — 


5^ ( 1 ^? + ^- £ (n) 1 +^) 


J- + Ifffl'l 

3n ~ n \n ) 


1 + 1_ ^ + 9^ _2 ( 1_ ^) ( 1- ^- + ^? £ (n)) 3n2- ^ + 9^ _2 +^ + ^- + ^- £ (n) 


1 


9n 2 1 


1 -\- £ [ — 
n 


1 -{- £ [ — 
n 


— 2 , _ 

9n 2 n 2 U n 2 8 \n 


fUJ\ 


0 i+9 “ 2+e & 


hence 


1 


*0 *”(") = = T 0 = *»(")- 

9 + " 


where E is the random variable from 1 ., corresponding to a = 

O 

Since k y (uo) is continuous, (X n ) converges in distribution towards E for a — thus 


fy(y) = 1 exp f-y 


y ER. 
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Example 6.10 1. Let X be a random variable with the characteristic function k(ca). 
Prove that the random varible Y = —X has the characteristic function 


ky((j) = k(uj). 

Let X\ and X 2 be independent random variables, both of the distribution given by 




j e N; i = 1, 2. 


2 . Find the characteristic function ki(uj) for X\. 

3. Find the distribution of the random variable Z = X\ — X^- 

4. Find, e.g. by using the result of l. ; the characteristic function for Z. 

Let Zi, Z 2 , ... be mutually independent random variables, all of the same distribution as Z, and let 



5. Prove e.g. by using characteristic functions that the sequence (U n )^ =1 converges in distribution 
towards a random variable U, and find the distribution function of U. 


1 ) Since X is real, it immediately follows that 

fcy(cj) = E {e iu;Y } = E {e~ iujX } = E{e i “ x } = k x (uj). 
Alternatively, 

ky(uj) = £?{cos(o;F) + i sin(o;F)} = E{cos(—uoX) + i sin(— uX)} 


E{cos(o;X) — i sin(o;X)} = k x {uS). 


2) The characteristic function is 



1 


3) The distribution function is 


F z (z) = P{X 1 -X 2 <z} = Y / E J _ k < [z] P{Xl=j} ' P{X2 = k} 



1 

00 k+[z] , 1 v j , 1 x k k ~ 




^ \ k+[z\ + l 

2) 


fc=max{l,l- [z]} j =1 


fc=max{l,l- [z]} 



99 


Download free eBooks at bookboon.com 











Analytic Aids 


6. The characteristic function 


If 2 < 0, then 



If 2 > 0, then 



Summing up, 


F z (z) = 


2 /1\ N 
3 VV 




hvis z < 0, 

[z] integer part of z. 


if z > 0, 
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Alternatively, Z = X\ — X2 is its values in M. By the symmetry, 

P{Z = k} = P{Z = -k}. 

If k > 0, then 

°° 00 / I \ 3+ k / -I \ 3 

P{Z = k} = P{Z = -k} = Y J P{Xi=j + k}-P{X 2 =j} = Y J (i 2 J (2 


J =1 


j=l 


- G)gG)'-u 


1_ I 3 V2 
4 


k G No, 


where we describe the distribution by the probabilities of the points. 
4) It follows from 1. and 2. that 

e iuj e -iuj 1 

k z (id) 2 — e ZUJ 2 — e~ luJ 5 —4 cos a; 

Alternatively, kz{ui) is computed in the following way, 


00 00 1 oc / 1 \ k 1 oc / 1 

k z (u) = Y / P{Z = k}e ik “+J2 p { Z =-k}e- ikuJ =~'E[2 ei l + aEU 

0 fc=0 v 


fc =0 


fc =0 


3 ^ V2 

fe=i 


3 


1 


2 6 


1 %R‘'+R*-L, 


1 - - e iuj 1 - - e“ iu; 

2 2 

cj G I 


-COS U) 

4 


5 — 4 cos (j 

5) The characteristic function for U n is 


4 5 

-COS CJ 

4 




cj 


5 — 4 cos —= 

V n 


We conclude from 


5 — 4 cos —= ) = ( 5 — 


Inn \nJ J 


= 1 


2lo 2 1/1 

-1— e ( — 

n n \n 


that 


kjj n (u) —> lim 

n n—► 00 


r 2lo 2 

1 i 

/i\ 

r n 

< 1 H- 

4— £ 

- 

r = e 

l n 

n ' 


J 


— 2u; 


We see that ku{u) = exp - • 4c u 2 J is continuous, hence U G 7V(0,4), and U n —> U in distribu¬ 
tion, where U G 7V(0,4) is normally distributed. 
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Alternatively we may use that X\ and X 2 are both geometrically distributed of variance 2, 
hence the have the variance 4. Then it follows from the Central Limit Theorem that 



for n —» oc converges in distribution towards V G 7V(0,1). 
Then 


u n -G u e JV(o,4). 


Example 6.11 Let X\ and X 2 be independent random variables of distribution given by 
P{X 1 =j} = P{X 2 =j}=pq\ j e No, 


where p > 0, q > 0, p + q = 1, and let Y = X% — X 2 . 

1. Find the mean and variance ofY. 

2. Find P{Y = j} for every j G Z. 

3. Find the characteristic function for X\ and the characteristic function for —X 2 , and thus this to 
find the characteristic function for Y. 

Given a sequence of random variables {Y n )^ =1 , where for each n G N, the random variable Y n has a 

distribution as Y corresponding to p = —, q = 1-. Let Z n = —Y n . 

2 n 2 n n 

4. Prove, e.g. by using 3. that the sequence (Z n )^ =1 converges in distribution towards a random 
variable Z, and find distribution of Z. 

1) Using that X 1 and X 2 are identically distributed and that both the mean and the variance exist, 


we get 


E{Y} = E{X 1 }-E{X 2 }= 0, 


andd 


V{Y} = 2V{X 1 } = 2E{Xf} = 2E{X 1 (X 1 -l)}+2E{X 1 } 



00 00 / 1 \ 2 


2) The probability is 


P{Y = j}= ]T P{x 1 =i}-P{x 2 = k}=p 2 Y, a A 


t—k=j 

£>0,k>0 


i—k=3 

£>0,k>0 


If j > 0, then £ = k + j, hence by the symmetry, 


OO OO 2 T 

p{r = j} = p{r = -j} = P 2 Y <i k+j • = pV E fa 2 )* = t~X = fr~ 

tt S 1 + 9 
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3) he characteristic function for X\ is 


k x M = Y J P{Xi = k}e ik “ =pY J <l k ( ei “) 

k =0 k =0 

The characteristic function for — is 

K- X2 (uj) = k Xl (~u) = 

The characteristic function for Y = X\ — X 2 is 

P V 


1 — qe l 


ky(u) = kx 1 (cu) ’ &-X 2 (+) = y~ 


P 


qe luJ 1 — qe luJ 1 + q 2 — 2g coso; 


4) The characteristic function for Z n = —Y n is 

n 


kz n {u) 


I 

2 n 


1 + - 211 -- 


^_ cog 4 n 2 + (2n — l) 2 — 4n(2n — 1) cos ^ 


Using an expansion of the denominator we get 

8n » _ 4„ + 1 - (8„ 2 - 4„) (l-I^ + -i £ (I)) 


= 8n 2 — 4n + 1 — 8n 2 + 4n + 4cu 2 — 2 — + 5 f ^ = 1 + 4cu 2 + 5 (— 

n \n) \n 


hence 

lim kz n (uj) = lim 


1 


1 


n—>oo n l 1 

1 + 4a; 2 + e ( — 
n 


1 + 4 cj 2 ' 


Since the double exponentially distributed random variable Z with a = - has the characteristic 
function 


1 

kz{w) = , ^ 2 

'V 


1 


21 +w2 


1 + 4 a; 2 ’ 


we conclude that (Z n ) converges in distribution towards Z. 
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Example 6.12 A random variable X has the frequency 
1 sin 2 x 


/O) 


X ^ o, 


x = 0. 


7T X* 

1 

7T 

1. Find £Ae median of X. 

It can be shown (shall not be proved) that X has the characteristic function 


k(<jj) = < 


! _ M 
2 ’ 


M <2, 


0 , \u\ > 2 . 

2. Prove that X does not have a mean. 

Let X\, X 2 , X 3 , ... be mutually independent random variables, all of the same distribution as X. Let 


z n ——Xj , 

n ^ J 


n E N. 


3 =1 


3. Find the characteristic function for Z n . 

4. Prove that the sequence (Z n )“ Li converges in distribution towards a random variable Z, and find 
the distribution of Z. 


5. Compute the probability P ^ 2 <Z< 2 




1) It follows from f{—x) = f{x) that the median is (X) = 0. 

2 ) Since k{u) is not differentiable at u = 0, the random variable X does not have a mean. 

3) The characteristic function for Z n is 


**»={* 0 } 


= < 


M 


1 — — ) for \u\ < 2n, 


for leu I > 2 n. 


Since exp ( —— ) is continuous, 


4) Now, kz n { cu) —> exp ^—— j for n —» 00 and every fixed uj E 

(Z n ) converges in distribution towards Z. Using a table we see that Z E C ^0, - ) is Cauchy 
distributed of the frequency 
1 

fz(z) = 2 


7T | ^ 


7T 1 + ( 2Z ) 2 


for 2 ? E 
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5) The probability is 


r 1 ii_2 dz _ i r 1 dt 

\ 2 < < 2 / -TT J_1 l + (2 z) 2 7r J_ 1 1 + t 2 


2 _ * ,i 1 

[Arctan tjg — —. 

7T 2 


Example 6.13 ITe say that a random variable X has a symmetric distribution, if X and —X have 
the same distribution. 

Assume that X has the characteristic function kx{u). Prove that —X has the characteristic function 
k-x{u) = kx im¬ 
prove that the characteristic function for X is a real function, is and only if X has a symmetric 
distribution. 


The first question is almost trivial, 

fc-xM = E {e~^ x } = ~E {e* wX } = k^j). 
1) If X has a symmetric distribution, then 
k-x{u) = kx{u) = kx{u), 
and we conclude that kx{u) is real. 
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2 ) Conversely, if kx(u) is real, then 
k-x(u) = kx{u) = kx(w), 

from which follows that — X and X have the same characteristic function, and hence the same 
distribution. This proves that X has a symmetric distribution. 

Example 6.14 Prove that the characteristic function for the distribution given by 


P {X = -n} = P{X = n}=^—, n = 2,3,..., 

n z Inn 


where 



is of class C 1 . 

Hint: The problem is to prove that the termwise differentiated series 


oo 



n Inn 


n =2 


is uniformly convergent on M. Show this by successively proving that 

i) 



2 ) 



wel, p, N e N, p < N. 


3) 



Here we shall also use Abel’s formula for partial summation, which is written 



where 



n 


n=p 


n=p 


k=p 


Abel’s formula above is similar to partial integration; ’ here we use sums instead of integrals. 

The claim follows easily from the estimate in 3., because the right hand side tends towards 0 for 
p —» oo, independently of u G M. 


oo, independently of u E M. 
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1) If p < q and c o 7 ^ 2 mpi, then 


q 

^ sin n uj 

n=p 


Im e l 7 


Im 


n=p 


e opuj _ e i(q+l)u 

1 - e iu; 


Im 


exp (i (q + |) lo) - exp (i (p - |) o>) 

h {exp (if) - exp (-if)} -2z 


2 sinf 


•{ C °s(p-i 


- 2 ) w_cos I <? + 2 ) u 


thus we get the estimate 


q 

sin n a; 

n=p 


< 


1 + 1 
2 | sin f | 


1 

sinf 


for uj 7 ^ 2m 7 T, m G Z. 


Notice that the left hand side is 0 for uj = 2m 7 r, m G Z. 

2) Due to the periodicity it suffices to consider cu G [— 7 r, 7 r]. Using that sinus is an odd function, it 
follows that it even suffices to consider uj G [ 0 , 7 t]. Finally, if follows from 1. that we can restrict 
ourselves to co G ]0,cuo], where 

CJ 0 = 2 Arcsin —-—. 

7T + 1 

7T 

Let N > p, and choose c o v m We group the terms in the following way, 

p 



fco-i (fe+i)p 

= E E 


/c=0 n=/cp+l 


1 

n 


sin 


n- ) + 

p J z —' n 

7 n=/c 0 p+l 


* 1 

— sin 



where 




N — 1 
V . 


denotes the integer part of (N — 1 )/p. We note that the sequence (in k) 



is alternating and that the corresponding sequence of absolute values tends decressingly towards 
0. Thus we get the following estimate, 



< 


< 




01 


E li r p 7T 

— • n —f 1 < 2 • ^ • —F 1 = 7 T + 1 . 
n p 2 p 

n= 1 
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6. The characteristic function 


_ 7T 7T 

If - < cu < —, then we estimate upwards by 

p + 1 p 


sin rojj < sin ( n — | for n < 
V , 


Hence 

N 


E 1 

Z—/ ri 


n=p 


< it + 1, wGl, p, iV G N, p < N. 


3) Let 2 < p < g, and choose 


sinncu 


(2r?, — 


• i 4 x—> sin k(jj i 4 i 

with A n = 2_^ — r —, \A n \ < 7 rl 


k=p 


according to 2.. Finally, choose b n 
that 


--. Then it follows by an application of Abelian summation 

Inn 


E 

n=p 


sinncj 

n 


1 

Inn 


q ~ x / i 

E ^ 


n=p 


ln(n + 1 ) 


+ A q * 


1 

lng 


Thus we get the estimate 


s I)- 4 ”! (i^ ‘ M^I)) + ' Ei 

“ ^ + 1 *{S( lnn ln (« + i)) + 

as required. 

As mentioned above it then follows that the termwise differentiated series is uniformly convergent, 
and the characteristic function is of class C 1 . 


1 I _ 7T+1 
lng f lnp 


q • i 

smno; 1 
n Inn 


n=p 
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Central Limit Theorem, 87, 91, 100 
characteristic function, 12, 83 
completely monotone function, 77 
continuity theorem, 7 

convergence in distribution, 11, 17, 49, 50, 52, 
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convergence in probability, 64 

Dirac’s $ “function”, 95 

double exponential distribution, 14, 101 

Erlang distribution, 10, 14 

exponential distribution, 10, 14, 42, 46, 51, 55, 

67, 82 

Fourier transform, 13 

Gamma distribution, 10, 15, 47, 72, 79 
GauBian distribution, 15 
generating function, 4, 5, 18 
geometric distribution, 6, 18, 38, 41, 100 

inversion formula, 9, 13, 85, 89, 93 

Laplace transformation, 8, 46 
logarithmic distribution, 49 

mean, 6 

moment, 6, 10, 15 

negative binomial distribution, 6, 24, 34 
normal distribution, 15, 75, 88, 91, 99 

Pascal distribution, 6, 37, 40, 73, 79 
Poisson distribution, 4, 6, 25, 28, 37, 34, 38, 

67, 83 

rectangular distribution, 15, 56, 84 
symmetric distribution, 103 
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